Commit Graph

46 Commits (master)

Author SHA1 Message Date
Julian M. Kunkel e8eb77166a Bugfix advanced tests to work with new validation with stonewall. 2021-04-28 13:41:19 +02:00
Julian M. Kunkel 47f3709c68 MDTest bugfix options -f -l -s and add extra option check #365 2021-04-27 14:50:19 +02:00
Julian Kunkel a436395570
Support random data generation for memory pattern in utilities. (#348)
* Support random data generation in utilities. Update first 8 byte element in each 4k block on updates to defy dedup.
* Incorporate different packet types into mdtest/md-workbench.
* Integrated utilities memory pattern tools into IOR. Now all tools use the same patterns.
* Added IOR long option for compatibility between IOR and other tools.
* Added new tests for random buffers.
2021-03-18 21:42:50 +01:00
Julian M. Kunkel bdde24bd91 Save testlogs into directory per type. 2021-02-05 11:24:53 +00:00
Julian M. Kunkel b4db470459 Testing improvements.
Uploaded new mdtest patterns. Make them invariant to line nrs.
Added md-workbench tests.
Added --oversubscribe option if MPI understands it (needed for some systems)
2021-02-05 11:17:15 +00:00
Julian M. Kunkel 970c5ef139 Adjust complex tests for changed -z behavior. 2021-01-20 14:57:21 +00:00
Julian Kunkel 8de13884a7
HDFS module ported to current AIORI API and improved (#302)
* HDFS module ported to current AIORI API and extended
* Added instructions how to build and run with a HDFS.
* Replaced read with pread to support offsets.
* Implemented HDFS MDTest API
* Improved sync semantics
2020-12-23 11:51:31 +00:00
Julian M. Kunkel 65666faf8b Updated tests to have transfer != blocksize for new random variant. 2020-11-06 11:43:52 +00:00
Julian M. Kunkel 8ca388fc78 Merge branch 'feature-cleanup-aiori' 2020-07-21 09:26:03 +01:00
Karsten Weiss f280123d0b Spelling fixes (found by codespell) 2020-07-03 09:16:30 +02:00
Julian M. Kunkel a12ed015a6 S3: better testing, stat is semi-fake, other functions aren't. 2020-07-02 16:40:20 +01:00
Julian M. Kunkel fb9fa7cc9f S3: Better cleanup. 2020-07-02 15:57:46 +01:00
Julian M. Kunkel fcae6ff0b9 S3: Fine tuning, supporting bucket per file/dir and single bucket. 2020-06-30 20:02:36 +01:00
Julian M. Kunkel 154cf2cde7 LibS3 version that stores fragments as one object each. 2020-06-30 18:43:44 +01:00
Julian M. Kunkel 2a3838c360 S3: Partial implementation. 2020-06-30 16:50:13 +01:00
Julian M. Kunkel 3cb144e7f3 Added regression test for JSON #202 2020-06-25 14:44:55 +01:00
Julian M. Kunkel 361a3261d1 Updated test patterns 2019-08-03 09:15:34 +01:00
Julian M. Kunkel 07217c93aa Bugfix for the parsing of flags. Backwards compatibility for direct IO. 2019-04-02 12:08:31 +01:00
Julian M. Kunkel 07ca5247d7 Checked proper IOR behavior for -f option. 2019-03-27 20:37:46 +00:00
Julian M. Kunkel 4d3d06da7a New testing framework for mdtest. The framework compares the observed with the expected pattern for the runs. For a new test, the pattern is recorded. Note that the tests are enumerated. 2018-12-20 21:09:34 +00:00
Julian M. Kunkel dced60b060 Added test for bug #112. 2018-12-20 20:40:53 +00:00
Glenn K. Lockwood d8d4742523 fixes #87
Leading whitespace is stripped from each line of the ior input file.  This
allows indented comments to be treated as comments.  However it does NOT allow
one to specify excessive whitespace inside of the `ior start` and `ior stop`
magic phrases.

Also added a test to catch regressions in this functionality.
2018-10-05 22:50:34 -07:00
Glenn K. Lockwood e448ff266d fix various issues related to release packages
- travis now tests the packaged source to detect missing source/headers
- basic tests are less sensitive to the directory from where they are run
- fixed some missing files from the `make dist` manifest
- updated the format of NEWS to work with `make dist`
2018-09-21 18:35:48 -04:00
Shane Snyder bdf8e61dd1 add notes ob how to run IOR against ceph/demo 2018-08-14 17:52:04 -05:00
Julian M. Kunkel bd253cf058 Added compilation test for HDF5. 2018-07-14 11:23:43 +01:00
Julian M. Kunkel d46402ff7c Bugfix for SeLinux by Enno 2018-07-12 19:33:08 +01:00
Julian M. Kunkel 205b20f0f4 Bugfix merge 2018-07-12 16:13:40 +01:00
Julian M. Kunkel fd4c306b98 MDTest stonewalling with status file.
Appears to work; stonewall timer is honored only in the creation phase.
This implies a limit to the objects that then are used for other phases.
2018-07-07 23:56:39 +01:00
Julian M. Kunkel 7bc868d5cf Dummy AIORI supporting MDtest ops. 2018-07-07 20:01:03 +01:00
Julian M. Kunkel 812b798f05 IOR allows to store actual performaned stonewalling count into a status file. 2018-07-07 14:01:11 +01:00
Julian M. Kunkel e10bebe653 MDTest supports only POSIX at the moment. Added command line check. 2018-07-07 12:14:34 +01:00
Julian M. Kunkel 231ebe9670 Split test. 2018-07-07 11:57:10 +01:00
Julian M. Kunkel 21b8cca8cf IOR library version. 2018-07-07 11:42:21 +01:00
Julian M. Kunkel a6bfa0f94b MDTest library option.
Moved core functionality / variables used by both implementations to utilities
2018-07-07 10:42:48 +01:00
Julian M. Kunkel fabc74759e Minor cleanup. Really use /dev/shm now. 2018-07-07 00:43:24 +01:00
Julian M. Kunkel c57f809654 Test scripts can be run from any directory. 2018-07-07 00:20:07 +01:00
Julian M. Kunkel b5e7212d84 Moved testfile to /dev/shm to not degrade hardware and speedup testing. 2018-07-07 00:13:43 +01:00
Julian M. Kunkel de1d3ff266 Docker local testing of 4 distributions. 2018-07-07 00:10:58 +01:00
Julian M. Kunkel aca75a3037 Simple testscript based on preexisting tests. 2018-07-06 22:19:25 +01:00
Julian M. Kunkel a3c773d006 Cleanup of old testing code. 2018-07-06 21:47:16 +01:00
Julian M. Kunkel 2c224e0ee8 Bugfix for #14, storeFileOffset=1 2017-11-30 11:56:26 +01:00
Julian Kunkel 4c5856469b Configuration to trigger #14 2017-11-29 10:02:34 +01:00
Jeff Inman 37738dab26 Numerous changes to file-modes, small build-tweaks, and a tweak to aiori-S3.c
(Only rank-0 should create the bucket, if it doesn't already exist.)

Prepping this for a push (as an experimental S3 build) to github.
2015-05-19 09:36:28 -06:00
Christopher J. Morrone 3d47f76736 Remove CVS references 2012-01-08 19:43:41 -08:00
Christopher J. Morrone 44ae2f171f Fix python path 2011-10-27 18:46:30 -07:00
Christopher J. Morrone a56d39e6f1 Start with the code from IOR-2.10.3 2011-06-17 12:20:43 -07:00