summaryrefslogtreecommitdiffstats
path: root/glustolibs-io
Commit message (Collapse)AuthorAgeFilesLines
* [LibFix] Add arequal support on given pathubansal2020-06-151-3/+7
| | | | | | | | Calculates arequal for a particular path in the mountpoint Change-Id: I018302e6dbb11a9c11d42fc0381ec4183b3725a0 Signed-off-by: ubansal <ubansal@redhat.com>
* [Lib] Add Lib to open FDubansal2020-06-101-1/+19
| | | | | | | | Opens a FD to a file , waits and then writes to the file Change-Id: Ib993b646ba45d2b05a5765e02b6b1b7b2869ecd3 Signed-off-by: ubansal <ubansal@redhat.com>
* [lib] Adding function upload_file_dir_ops() to io/utils.pykshithijiyer2020-01-071-0/+28
| | | | | | | | | | | | | | | | | | | | | Adding a function upload_file_dir_ops() to upload file_dir_ops.py to all clients. This is to remove the redundant code given below: ``` g.log.info("Upload io scripts to clients %s for running IO on " "mounts", cls.clients) cls.script_upload_path = ("/usr/share/glustolibs/io/scripts/" "file_dir_ops.py") ret = upload_scripts(cls.clients, cls.script_upload_path) if not ret: raise ExecutionError("Failed to upload IO scripts to clients %s" % cls.clients) g.log.info("Successfully uploaded IO scripts to clients %s", cls.clients) ``` Change-Id: I28ca528bfbaea20139808b7af812559715a27022 Signed-off-by: kshithijiyer <kshithij.ki@gmail.com>
* [Tool] Support for rsync, append, overwrite and truncate in file_dir_opskshithijiyer2019-12-181-2/+191
| | | | | | | | | | | | | | | | | Adding support for the below IO in file_dir_ops: 1. rsync 2. append 3. overwrite 4. truncate Changes required in CentOS-CI are submitted through the below pull request: https://github.com/gluster/centosci/pull/79 Change-Id: I0e5bc33894414ec885b2b6728a08e811b7982082 Co-authored-by: Ambarish Soman <asoman@redhat.com> Signed-off-by: Ambarish Soman <asoman@redhat.com> Signed-off-by: kshithijiyer <kshithij.ki@gmail.com>
* [Fix] Changing license to GPLv3+ in setup.py files.kshithijiyer2019-12-101-4/+4
| | | | | | | | | | The license details of the project needs to be updated for all the files in the project. Fixing all setup.py files in the project and submitting a patch. Change-Id: I7b53330a65891969403c6267e934606ea9b76352 Signed-off-by: kshithijiyer <kshithij.ki@gmail.com>
* [py2to3] Fix files located in the 'glustolibs-io' dirValerii Ponomarov2019-12-026-314/+244
| | | | | | | | | | | | | Do following things in the files from the mentioned directory: - Make it be python 2/3 compatible. - Fix pep8 issues. - Place imports in alphabetical order. - Improve some parts for the better readability. - Add comma separators in the setup.py for it's classifiers. Before it was mistakenly made as one long line. Change-Id: I3f0a5921a5386275a8a35bf2f22ee3952700e490 Signed-off-by: Valerii Ponomarov <kiparis.kh@gmail.com>
* [py2to3] Replace "print" statement with "print()" functionValerii Ponomarov2019-11-223-48/+50
| | | | | | | | "print" statement is not supported in py3. So, start using "print()" function everywhere in the code. Signed-off-by: Valerii Ponomarov <kiparis.kh@gmail.com> Change-Id: I5b3e39ce5d4973959d7cedd0aac6fc744e2fe7ef
* Cthon test case for NFS GaneshaArjun Sharma2019-09-121-0/+44
| | | | | Change-Id: I3fb826bd0ecbe46bee4b9f8594b23f16921adbec Signed-off-by: Arjun Sharma <arjsharm@redhat.com>
* glusto-test:generate_io.py code not correctyinkui2019-09-051-2/+1
| | | | | | | | | | According to generate_io.py the function "def check_if_percent_to_fill_or_timeout_is_met" will never return false, the "flag" empty or not empty also return true. Change-Id: I2d70b2987112bd3a6404e5f13f0c6d320d01e7fc Signed-off-by: yinkui <13965432176@163.com>
* Optimized glustolibs-io/shared_files/scripts/file_dir_ops.py.hadarsharon2019-08-281-46/+66
| | | | | | | | | Made the IO process more efficient for better performance, as lots of randomizations and conditionals within loops made the whole process very slow. Change-Id: Ie99340d6e5fae7ee88198a646f5b46f868c816ae Signed-off-by: hadarsharon <hsharon@redhat.com>
* Adding library to run_crefi() to glustolibs-IO.kshithijiyer2019-08-271-0/+128
| | | | | | | | | | | | | | | | | | | | | | | What is crefi? Crefi is a Python command-line tool to create multi threaded workload on a filesystem and do file operations on created data. It provides basic operations to create files of different sizes, different types, in different directory structures, along with creating symlinks, hardlinks to files, and also rename, truncate, chmod, chown, chgrp and setxattr on the created files. Typical use involves creating large number of files of different sizes, over different layout, and do different operations on the created files. Which components need this tool? - Geo-rep - AFR Changes needed in infrastructure: https://github.com/gluster/centosci/commit/1fe330d34a62b56438f6eb86538286962b1abd90 Change-Id: I1e579f6f1f2c6ef0d018c055234abbf0f147e621 Signed-off-by: kshithijiyer <kshithij.ki@gmail.com>
* Library: check arequal bricks checksum for replicated volumekshithijiyer2019-05-241-0/+60
| | | | | | | | | calculates arequal checksum for first brick in the subvol and compares it with all other remaining bricks in the subvol. Change-Id: Ifc34b29d7971673a8a19b3ba603f63e985be4150 Signed-off-by: srivickynesh <sselvan@redhat.com> Signed-off-by: kshithijiyer <kshithij.ki@gmail.com>
* Copy-pasta typo: bonnie -> fioYaniv Kaul2019-04-131-1/+1
| | | | | | | | Fix small copy-pasta error. Change-Id: I69166d429f87fa9e94b58d165275414ec49bf3f5 updates: bz#1193929 Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
* Added ret for io_resultsVitalii Koriakov2019-02-051-0/+2
| | | | | Change-Id: I34af7c73bae3a6ad7b32a2282f2e26da21597949 Signed-off-by: Vitalii Koriakov <vkoriako@redhat.com>
* Delete quorum method from old file. Added fixes for flake8Vitalii Koriakov2019-01-304-18/+18
| | | | | Change-Id: I2acf835a4cf7301c64c4c8a9423f78672cdf9aa4 Signed-off-by: Vitalii Koriakov <vkoriako@redhat.com>
* New method for checking not connected mount pointVitalii Koriakov2019-01-241-0/+64
| | | | | Change-Id: Idd492c3e806881ddc030023ecab30e4a8333467c Signed-off-by: Vitalii Koriakov <vkoriako@redhat.com>
* Per BZ 1401969, modifying the IO pattern to write single large filesAnees Patel2018-12-201-1/+1
| | | | | | | | | | | | When eager-lock is on, and two writes happen in parallel on a FD, Arbiter becoming source of heal is observed, hence modifing the IO pattern, Also this is a race-condition, hence executing the same remove-brick cycle thrice per BZ 1401969, this patch also takes care of multiple clients writing to different files/dirs, no two clients writing to same file Change-Id: If0003afb675bbcf9f6b555b43e9a11e4def5435c Signed-off-by: Anees Patel <anepatel@redhat.com>
* Using a raw strings for fixing flake warningsVitalii Koriakov2018-10-291-2/+2
| | | | | Change-Id: Ie134790ea05919a4b396657c11cbc3fc7a7fc529 Signed-off-by: Vitalii Koriakov <vkoriako@redhat.com>
* Supporting python 2 and 3Vitalii Koriakov2018-09-241-30/+34
| | | | | Change-Id: I6caa4f6baf699e331bb01af97e019d35b6bb0583 Signed-off-by: Vitalii Koriakov <vkoriako@redhat.com>
* Fix spelling mistake across the codebaseNigel Babu2018-08-073-4/+4
| | | | Change-Id: I46fc2feffe6443af6913785d67bf310838532421
* Shorten all the logs around verify_io_procsYaniv Kaul2018-07-171-1/+4
| | | | | | | | No functional change, just make the tests a bit more readable. It could be moved to a decorator later on, wrapping tests. Change-Id: I484bb8b46907ee8f33dfcf4c960737a21819cd6a Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
* Adding test case for change owner, group, permission for directoryMohit Agrawal2018-06-291-0/+42
| | | | | | | | | | | | | | | | | 1) Create Dir with some file inside dir 2) Verify dir exists on all bricks as well as mount point 3) Compare dir stat with mount-point and brick location path 4) Change the ownership of directory 5) Compare dir stats with mount-point and brick path 6) Try to change pemission with different user for directory 7) Compare dir stat with mount-point and brick path 8) Try to change permission with different user for directory 9) change permission of directory 10) Compare dir stat with mount-point and brick path 11) Try to change permission with different user for same directory Change-Id: I284842be8c7562d4618d4e69e202c4d80945f1c5 Signed-off-by: Mohit Agrawal <moagrawa@redhat.com>
* Snapshot:: Fix: view_snaps_from_mounts functionsrivickynesh2018-06-151-1/+1
| | | | | | | | | | fix for function view_snaps_from_mounts 1. Iteration through snap_list was incorrect as we were comparing snaps taken from snap_list against snap_list itself. 2. Now it is changed to snaps which is superset of all snaps. Change-Id: Ib14e7819f6fd49e563fd9e8a8f7699581a8900b4 Signed-off-by: srivickynesh <sselvan@redhat.com>
* Standalone script which runs the tools that generate data into the systemArthy Loganathan2018-04-201-0/+521
| | | | | Change-Id: I4c5a9baa1178a3fec4863e7cb7a81493ee4a52f7 Signed-off-by: Arthy Loganathan <aloganat@redhat.com>
* Adding is_io_procs_fail_with_rofs functionVijay Avuthu2018-02-061-0/+50
| | | | | Change-Id: If20aac0247dc42194a23c2b64952aac83234292e Signed-off-by: Vijay Avuthu <vavuthu@redhat.com>
* readthedocs.org fix /usr/share cannot open errorJonathan Holloway2018-02-061-2/+6
| | | | | | | Add a try around dir copy to eliminate readthedocs.org cannot open error Change-Id: Ie9160a8b7dc42839fe4c176c89aa67ae26c1266e Signed-off-by: Jonathan Holloway <jholloway@redhat.com>
* Fixing the glusto-tests Build Failures:ShwethaHP2017-11-231-2/+2
| | | | | | | | | | 21:00:43 ./glustolibs-gluster/glustolibs/gluster/lib_utils.py:67:5: E722 do not use bare except' 21:00:43 ./glustolibs-gluster/glustolibs/gluster/lib_utils.py:290:5: E722 do not use bare except' 21:00:43 ./glustolibs-io/shared_files/scripts/file_dir_ops.py:308:13: E722 do not use bare except' 21:00:43 ./glustolibs-io/shared_files/scripts/file_dir_ops.py:316:13: E722 do not use bare except' Change-Id: Ia0babf3d5a10b19c48425e4fcbcb8e79eea5e391 Signed-off-by: ShwethaHP <spandura@redhat.com>
* Script to run fio tool using ini job fileArthy Loganathan2017-10-105-0/+137
| | | | | Change-Id: Ie8237836a41d39de0de84b1d4d4b49f9af74b237 Signed-off-by: Arthy Loganathan <aloganat@redhat.com>
* Added modules to file_dir_ops.py to perform compress, uncompress,Arthy Loganathan2017-08-081-0/+367
| | | | | | | create hard link, read, copy and delete Change-Id: If81480450bdaecc59896682d6febb8c6c9463aa7 Signed-off-by: Arthy Loganathan <aloganat@redhat.com>
* glusto nfs-ganesha: Added test to verify nfsv4 acl functionality with glusterfsArthy Loganathan2017-08-011-0/+212
| | | | | | Change-Id: I2747c3770925b8d8f05e10fb7da49d105b7130e6 Signed-off-by: Arthy Loganathan <aloganat@redhat.com> Signed-off-by: Jiffin Tony Thottan <jthottan@redhat.com>
* Added nfs ganesha tests to run IO test suites from multiple clients and ↵Arthy Loganathan2017-06-201-0/+204
| | | | | | | checks nfs ganesha behaviour Change-Id: I2dc7f0fb016982b7b7fa4a87c0310e4c96376f94 Signed-off-by: Arthy Loganathan <aloganat@redhat.com>
* Adding Quota, Snapshot Components Sanity Tests.Shwetha Panduranga2017-03-081-7/+63
| | | | | | | | | 1) Quota: Enabling, Setting Limit, Disabling, Listing of Quota is tested. 2) Snapshot: Creating, Listing, Activating, Viewing the snap from mount, De-Activating of snapshots is tested. Change-Id: Ia91e86e121d5d3fcc038704031617594d3d601d4 Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* Adding a Gluster Basic Features Sanity test:Shwetha Panduranga2017-03-021-11/+46
| | | | | | | | | | Test volume set option while IO is in progress. This basically tests IO to be successful after the client graph changes. (Note: This case will be run as part of Build Verification Test Suite) Change-Id: I111cf0214596fe32c872fdc73c5ccb8ab4a308be Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* Adding io utils:Shwetha Panduranga2017-02-141-0/+286
| | | | | | | | | | | | | | | | | 1) collect_mounts_arequal: Required for most of the testcase validation. 2) log_mounts_info: Get some data of mounts before the test and after the test for debugging purposes in case of failure 3) get_mounts_stat: Recursively get stat from mounts. 4) validate_io_procs: Validates the io's which were started asynchronously on all the mounts. 5) cleanup_mounts: remove all the data from mounts. Change-Id: Idce5304a7c7656088ea73675f953afe976eb1721 Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* Clean up pyflakes and pep8 errorsNigel Babu2016-12-122-8/+7
| | | | | Change-Id: Ibdd092118d3bb912716c46fd278ef3c680a6e742 Signed-off-by: Nigel Babu <nigelb@redhat.com>
* Recursively copy the data_files to the specified location maintaining the sameShwetha Panduranga2016-10-251-7/+3
| | | | | | | directory structure. Change-Id: I1b50bb404066dc1a1562f406896b6a5bbf866a72 Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* Modifying file_dir_ops to handle/return failures during creation of deep dirsShwetha Panduranga2016-10-251-24/+207
| | | | | Change-Id: I16c14564f3b0a9067e420715319cf21c9459815f Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* Adding a script to perform fd writesShwetha Panduranga2016-10-201-0/+254
| | | | | Change-Id: I76d6d208618424f020506f1e26493a65da4a97b3 Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* Adding a sample io program which creates/renames/list files/dirs under given dirShwetha Panduranga2016-10-172-0/+502
| | | | | Change-Id: Iefeadfe3bd943b2488775bb214b98967f8ce7133 Signed-off-by: Shwetha Panduranga <spandura@redhat.com>
* glustolibs: add initial treeJonathan Holloway2016-09-293-0/+55
Change-Id: I08900d87fcd9a11b4f157d235facb766905d5ae2 Signed-off-by: Jonathan Holloway <jholloway@redhat.com>