Commit Graph

209 Commits (0f7a1f14b96306c79b448df5ee660be4ae017fb2)

Author SHA1 Message Date
Julian M. Kunkel 0f7a1f14b9 Support IO redirect from main() 2018-07-08 13:12:18 +01:00
Shane Snyder 0052bff3e9 use backend->access in IOR source
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 12:13:38 +01:00
Shane Snyder 8069e018e3 make ncmpi/hdf5 use mpiio access/delete
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 12:13:38 +01:00
Julian M. Kunkel 1a3c92718b Fix merge 2018-07-08 12:13:08 +01:00
Shane Snyder 7d3c7e901e expose generic aiori_ calls for access, etc.
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 12:09:44 +01:00
Enno Zickler 9e97a16fe4 fix output to be allinge with column headers
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 11:54:49 +01:00
Julian M. Kunkel d938f0efe1 MPIIO support fsync. 2018-07-08 00:16:30 +01:00
Julian M. Kunkel fd4c306b98 MDTest stonewalling with status file.
Appears to work; stonewall timer is honored only in the creation phase.
This implies a limit to the objects that then are used for other phases.
2018-07-07 23:56:39 +01:00
Julian M. Kunkel 58f13ba352 Bugfix: extraction to count ranks per host used local communicator. 2018-07-07 22:54:40 +01:00
Julian M. Kunkel 31e3cc2b60 Bugfix extraction further. 2018-07-07 22:46:13 +01:00
Julian M. Kunkel b27b50184a Bugfix Refactoring MaxLen 2018-07-07 22:42:05 +01:00
Julian M. Kunkel ed5787811c Extracted max pathlen variable. 2018-07-07 22:39:14 +01:00
Julian M. Kunkel 48c17b4d81 Extracted (nearly identical) function DelaySeconds. 2018-07-07 22:26:57 +01:00
Julian M. Kunkel 6f8d2e8845 Some simplification / unification between IOR and MDTest.
MDTest needs more refactoring to be really maintainable.
2018-07-07 22:19:42 +01:00
Julian M. Kunkel 7bc868d5cf Dummy AIORI supporting MDtest ops. 2018-07-07 20:01:03 +01:00
Julian M. Kunkel b4f356a7b2 Bugfix: StoneWallingStatusFile. 2018-07-07 14:14:55 +01:00
Julian M. Kunkel 812b798f05 IOR allows to store actual performaned stonewalling count into a status file. 2018-07-07 14:01:11 +01:00
Julian M. Kunkel 378789737f Dummy AIORI driver 2018-07-07 13:25:17 +01:00
Julian M. Kunkel 15c383b0d1 Extended description for #44 2018-07-07 12:20:29 +01:00
Julian M. Kunkel e10bebe653 MDTest supports only POSIX at the moment. Added command line check. 2018-07-07 12:14:34 +01:00
Julian M. Kunkel 231ebe9670 Split test. 2018-07-07 11:57:10 +01:00
Julian M. Kunkel e31b2dcec1 Added missing file. 2018-07-07 11:57:04 +01:00
Julian M. Kunkel 21b8cca8cf IOR library version. 2018-07-07 11:42:21 +01:00
Julian M. Kunkel a6bfa0f94b MDTest library option.
Moved core functionality / variables used by both implementations to utilities
2018-07-07 10:42:48 +01:00
Julian M. Kunkel bcaea2a39f Replaced getopt with an alternative version (on some machines optind was broken). 2018-07-07 08:41:33 +01:00
Julian M. Kunkel fabc74759e Minor cleanup. Really use /dev/shm now. 2018-07-07 00:43:24 +01:00
Julian M. Kunkel c57f809654 Test scripts can be run from any directory. 2018-07-07 00:20:07 +01:00
Julian M. Kunkel b5e7212d84 Moved testfile to /dev/shm to not degrade hardware and speedup testing. 2018-07-07 00:13:43 +01:00
Julian M. Kunkel de1d3ff266 Docker local testing of 4 distributions. 2018-07-07 00:10:58 +01:00
Julian M. Kunkel 2148f68d36 Allow to use README.md instead of README. 2018-07-06 22:42:46 +01:00
Julian M. Kunkel 98bbafd0d4 Readme renamed to enable markdown and proper build passing item. 2018-07-06 22:30:08 +01:00
Julian M. Kunkel 7cb659e55d Added default tests to travis. 2018-07-06 22:27:17 +01:00
Julian M. Kunkel aca75a3037 Simple testscript based on preexisting tests. 2018-07-06 22:19:25 +01:00
Julian M. Kunkel a3c773d006 Cleanup of old testing code. 2018-07-06 21:47:16 +01:00
Glenn K. Lockwood b172cd684f
Merge pull request #56 from adammoody/rdwr
fixes #55: open file in RDWR when using write + checkWrite
2018-05-16 18:19:17 -07:00
Adam Moody 156a514c8b open file in RDWR when using write + checkWrite 2018-05-16 16:52:20 -07:00
Glenn K. Lockwood e5a01edff9
Merge pull request #54 from adammoody/mpiio_getfilesize
use MPI_COMM_SELF when opening file to get file size in MPIIO file per process
2018-05-16 13:30:49 -07:00
Adam Moody 43cc47b7f0 use MPI_COMM_SELF when opening file to get file size in MPIIO 2018-05-16 12:31:23 -07:00
Glenn K. Lockwood 945fba2aa2
Merge pull request #52 from lidongyang/mmap
Add mmap as a new AIORI backend
2018-05-10 20:54:34 -07:00
Li Dongyang 6ba22a19e4 Add mmap as a new AIORI backend
It shares the create/open/delete/set_version/get_file_size
functions with POSIX backend.
The mmap backend also supports fsync and fsyncPerWrite options,
and it will use msync() instead and fsync().

Signed-off-by: Li Dongyang <dongyangli@ddn.com>
2018-05-11 12:13:42 +10:00
Glenn K. Lockwood 7a371cfeda
Merge pull request #46 from lidongyang/iops
Add OPs result columns back
2018-04-23 13:12:43 -07:00
Glenn K. Lockwood a80cc44fb1 fixes #47 2018-04-23 13:10:04 -07:00
Li Dongyang 0d2c9e5451 Add OPs result columns back
Signed-off-by: Li Dongyang <dongyangli@ddn.com>
2018-04-18 14:24:42 +10:00
Glenn K. Lockwood 907cbb806b
Merge pull request #42 from ezickler/wip/new-doc
New documention with sphinx and Doxygen for readthedoc.io
2018-03-16 14:34:05 -07:00
Enno Zickler 16c8ef6a23 Doc: src comments for getOffsetArray functions 2018-03-15 21:52:34 +01:00
Enno Zickler 6267203147 Doc: add tutorial, user guide and CI
This adds a beginners tutorial and splits up the conten of the old user
guide in categories. In the developer section gets a page for the
travis-CI.
2018-03-15 21:52:34 +01:00
Enno Zickler d5507955af Doc: Initial setup for Sphinx and Doxygen 2018-03-15 21:52:10 +01:00
Glenn K. Lockwood a4df0fda55
Merge pull request #37 from ezickler/feature/travis-ci
Add Travis-CI config file
2018-03-09 16:00:47 -08:00
Glenn K. Lockwood c40317f75d
Merge pull request #39 from jyvet/mpiio-access
Implement an access function for MPIIO backend
2018-03-02 09:59:03 -08:00
Jean-Yves VET 6d3edaffc8 Implement an access function for MPIIO backend
Context: Some file systems require a prefix in the path.
The POSIX 'access' call fails and consequently files are
never deleted.

This patch implements an access function in the MPIIO
backend using MPI_File_open. Prefixes can now be parsed
by ROMIO.
2018-03-01 11:34:49 +01:00