Commit Graph

783 Commits (ad3bf97304ff1d623c83661521ef80e19e0d9c23)

Author SHA1 Message Date
Julian M. Kunkel fb8f43fcfe Reduce verbosity for verification 2020-07-01 10:05:09 +01:00
Julian M. Kunkel 371335195b Initialize logfile for warnings if not set. 2020-07-01 09:42:13 +01:00
Julian M. Kunkel 484cb420d2 Generate config file with build options 2020-07-01 09:19:10 +01:00
Julian Kunkel 728fa1e0f9
Merge pull request #234 from hpc/feature-write-check
MDTest changed verification pattern.
2020-06-30 20:06:41 +01:00
Julian M. Kunkel fcae6ff0b9 S3: Fine tuning, supporting bucket per file/dir and single bucket. 2020-06-30 20:02:36 +01:00
Julian M. Kunkel 87c9906d70 Error checking for NULL create/opens 2020-06-30 19:41:49 +01:00
Julian M. Kunkel 154cf2cde7 LibS3 version that stores fragments as one object each. 2020-06-30 18:43:44 +01:00
Julian M. Kunkel 2a3838c360 S3: Partial implementation. 2020-06-30 16:50:13 +01:00
Julian M. Kunkel 81a7a3ab81 Renamed existing S3 impl. which uses (apparently) outdated library. Added dummy support for libS3 with library search. 2020-06-30 13:41:59 +01:00
Julian M. Kunkel 3a9bd7828d Ported PMDK API. 2020-06-30 13:12:44 +01:00
Julian M. Kunkel 82417128cd Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI. 2020-06-30 12:33:56 +01:00
Julian M. Kunkel 3395fc621c Moved GetFileSize into CheckFileSize, starting to simplify get_file_size (too much replication in modules). 2020-06-30 12:03:05 +01:00
Julian M. Kunkel 5a5b90cdaa Run existing check to allow only supported backends in mdtest. 2020-06-30 11:17:46 +01:00
Julian M. Kunkel 3e6bfd2db7 Added missing header info. 2020-06-29 20:58:45 +01:00
Julian M. Kunkel 03dbb20594 MDTest changed verification pattern. Read now always checks the first byte/8 bytes for the signature (item number).
Added also --verify-write option which performs a read immediately after a write. Supports #206
2020-06-29 20:15:14 +01:00
Julian M. Kunkel df3f7082d8 MDTest: Added warnings/errors for errorneous read pattern #206 2020-06-28 17:21:24 +01:00
Julian M. Kunkel 145c71f7c3 Trivial cleanup: Extracted debug-related stuff into new header. 2020-06-28 17:16:56 +01:00
Julian M. Kunkel 7edd559c01 Added missing news. 2020-06-28 16:49:57 +01:00
Julian M. Kunkel 3cb144e7f3 Added regression test for JSON #202 2020-06-25 14:44:55 +01:00
Julian M. Kunkel 38b1752bda JSON issue with results. Fix for #233. 2020-06-25 14:37:52 +01:00
Julian M. Kunkel 0bffd14de7 Added --warningAsErrors option to IOR and MDTest and refactored WARNINGs in IOR. #174 2020-06-24 11:13:12 +01:00
Julian M. Kunkel c55848f14d Bugfix based on the pull request for fix-189. Should fix #189. 2020-06-24 10:15:31 +01:00
Julian Kunkel 71874f9b90
Merge pull request #199 from adrianjhpc/master
PMDK backend with dual mount options
2020-06-24 09:50:12 +01:00
Julian Kunkel d5de9bcc77
Merge branch 'master' into master 2020-06-24 09:50:03 +01:00
Julian Kunkel 8faa6c88d6
Merge pull request #195 from jschwartz-cray/fix-194
Fix #194.
2020-06-24 09:43:56 +01:00
Julian Kunkel 6a88b37171
Merge branch 'master' into fix-194 2020-06-24 09:43:37 +01:00
Julian Kunkel 6e507f732c
Merge pull request #225 from hpc/fix-modules
Improve AIORI module behavior
2020-06-24 09:26:19 +01:00
Julian M. Kunkel c105d014b2 Increased version number in preparation of a new release. 2020-06-24 09:23:01 +01:00
Julian Kunkel d483e3bf9d
Merge branch 'rc' into master 2020-06-24 08:58:08 +01:00
Julian Kunkel 39ca1f25fe
Merge pull request #230 from mchaarawi/fix-modules
merge from master
2020-06-11 21:05:52 +01:00
Mohamad Chaarawi b4a54c34e8 Merge branch 'master' into fix-modules
Conflicts:
	src/aiori-DAOS.c
	src/aiori-DFS.c
2020-06-11 19:55:23 +00:00
Julian Kunkel 825dcef337
Merge pull request #229 from mchaarawi/fix-modules
update DFS and DAOS drivers to new aiori module interface.
2020-06-11 20:03:33 +01:00
Mohamad Chaarawi e08314f571 update DFS and DAOS drivers to new aiori module interface.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-06-11 17:26:58 +00:00
Julian M. Kunkel eb2cd27fac Removed offset from IOR structure. 2020-06-10 17:47:07 +01:00
Glenn K. Lockwood d4d3c72efb
Merge pull request #228 from breuner/fix-mdtest-directio
mdtest: use correct number of bytes for posix_memalign of read buffer
2020-06-02 16:22:58 -07:00
Sven Breuner c828a0f32c mdtest: use correct number of bytes for posix_memalign of read buffer
Fixes a typo in initial posix_memalign commit for DirectIO support.
2020-06-03 01:22:44 +03:00
Glenn K. Lockwood 9f07265d1e
Merge pull request #227 from breuner/fix-mdtest-directio
mdtest: allocate aligned buffers to support DirectIO
2020-06-02 15:06:50 -07:00
Sven Breuner 3eb488939d mdtest: allocate aligned buffers to support DirectIO 2020-06-03 00:30:38 +03:00
Julian Kunkel a369d94037
Merge pull request #226 from mchaarawi/master
DFS: allow multiple IO phases when ior_run() is called
2020-06-01 09:50:12 +01:00
Mohamad Chaarawi 3623f3b8bd DFS: allow multiple IO phases when ior_run() is called
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-31 16:20:58 +00:00
Julian M. Kunkel 8fa8ef0c02 Call backend statfs() instead of only POSIX-specific variant. 2020-05-31 13:30:31 +01:00
Julian M. Kunkel 5663593919 Moved generic IOR information to "hint" structure. Backends should only use the "hints" if set. 2020-05-31 12:50:03 +01:00
Julian M. Kunkel 8098c3740a Refactored fd into aiori_fd_t for type safety. 2020-05-31 12:12:49 +01:00
Julian M. Kunkel c4c19d3245 Fixed type typo in name. 2020-05-31 11:58:34 +01:00
Julian M. Kunkel 294b8891e6 Created dummy option type to provide type safety. Fixed various call issues for options. 2020-05-31 11:50:15 +01:00
Julian M. Kunkel e91b79cea0 Moved Lustre/GPFS/BeeGFS options into POSIX backend. Needs testing. Additional minor fixes. 2020-05-30 20:09:37 +01:00
Julian M. Kunkel 930ccdc68d Updated HDF5 to new module specification. 2020-05-30 19:01:20 +01:00
Julian M. Kunkel aa9e2ad815 MDTest updated for AIORI changes. 2020-05-30 18:30:26 +01:00
Julian M. Kunkel 1890aaaeb0 Started to move IOR specific knowledge out of AIORI.
For now, and compatibility, IOR options can still be set/internally accessed using the backends init_xfer_options.
This should be removed in the long run to strip away this dependency.
2020-05-30 18:19:48 +01:00
Julian M. Kunkel 2de4210311 Provide a string option parser function. 2020-05-29 16:05:42 +01:00