Julian M. Kunkel
a12ed015a6
S3: better testing, stat is semi-fake, other functions aren't.
2020-07-02 16:40:20 +01:00
Julian M. Kunkel
4f7350dc6a
MDTest remove testdir if created by MDTest.
2020-07-02 16:26:05 +01:00
Julian M. Kunkel
fb9fa7cc9f
S3: Better cleanup.
2020-07-02 15:57:46 +01:00
Julian M. Kunkel
fb8f43fcfe
Reduce verbosity for verification
2020-07-01 10:05:09 +01:00
Julian M. Kunkel
371335195b
Initialize logfile for warnings if not set.
2020-07-01 09:42:13 +01:00
Julian M. Kunkel
484cb420d2
Generate config file with build options
2020-07-01 09:19:10 +01:00
Julian M. Kunkel
fcae6ff0b9
S3: Fine tuning, supporting bucket per file/dir and single bucket.
2020-06-30 20:02:36 +01:00
Julian M. Kunkel
87c9906d70
Error checking for NULL create/opens
2020-06-30 19:41:49 +01:00
Julian M. Kunkel
154cf2cde7
LibS3 version that stores fragments as one object each.
2020-06-30 18:43:44 +01:00
Julian M. Kunkel
2a3838c360
S3: Partial implementation.
2020-06-30 16:50:13 +01:00
Julian M. Kunkel
81a7a3ab81
Renamed existing S3 impl. which uses (apparently) outdated library. Added dummy support for libS3 with library search.
2020-06-30 13:41:59 +01:00
Julian M. Kunkel
3a9bd7828d
Ported PMDK API.
2020-06-30 13:12:44 +01:00
Julian M. Kunkel
82417128cd
Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI.
2020-06-30 12:33:56 +01:00
Julian M. Kunkel
3395fc621c
Moved GetFileSize into CheckFileSize, starting to simplify get_file_size (too much replication in modules).
2020-06-30 12:03:05 +01:00
Julian M. Kunkel
5a5b90cdaa
Run existing check to allow only supported backends in mdtest.
2020-06-30 11:17:46 +01:00
Julian M. Kunkel
3e6bfd2db7
Added missing header info.
2020-06-29 20:58:45 +01:00
Julian M. Kunkel
03dbb20594
MDTest changed verification pattern. Read now always checks the first byte/8 bytes for the signature (item number).
...
Added also --verify-write option which performs a read immediately after a write. Supports #206
2020-06-29 20:15:14 +01:00
Julian M. Kunkel
df3f7082d8
MDTest: Added warnings/errors for errorneous read pattern #206
2020-06-28 17:21:24 +01:00
Julian M. Kunkel
145c71f7c3
Trivial cleanup: Extracted debug-related stuff into new header.
2020-06-28 17:16:56 +01:00
Julian M. Kunkel
38b1752bda
JSON issue with results. Fix for #233 .
2020-06-25 14:37:52 +01:00
Julian M. Kunkel
0bffd14de7
Added --warningAsErrors option to IOR and MDTest and refactored WARNINGs in IOR. #174
2020-06-24 11:13:12 +01:00
Julian M. Kunkel
c55848f14d
Bugfix based on the pull request for fix-189. Should fix #189 .
2020-06-24 10:15:31 +01:00
Julian Kunkel
d5de9bcc77
Merge branch 'master' into master
2020-06-24 09:50:03 +01:00
Julian Kunkel
6a88b37171
Merge branch 'master' into fix-194
2020-06-24 09:43:37 +01:00
Mohamad Chaarawi
b4a54c34e8
Merge branch 'master' into fix-modules
...
Conflicts:
src/aiori-DAOS.c
src/aiori-DFS.c
2020-06-11 19:55:23 +00:00
Mohamad Chaarawi
e08314f571
update DFS and DAOS drivers to new aiori module interface.
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-06-11 17:26:58 +00:00
Julian M. Kunkel
eb2cd27fac
Removed offset from IOR structure.
2020-06-10 17:47:07 +01:00
Sven Breuner
c828a0f32c
mdtest: use correct number of bytes for posix_memalign of read buffer
...
Fixes a typo in initial posix_memalign commit for DirectIO support.
2020-06-03 01:22:44 +03:00
Sven Breuner
3eb488939d
mdtest: allocate aligned buffers to support DirectIO
2020-06-03 00:30:38 +03:00
Mohamad Chaarawi
3623f3b8bd
DFS: allow multiple IO phases when ior_run() is called
...
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-31 16:20:58 +00:00
Julian M. Kunkel
8fa8ef0c02
Call backend statfs() instead of only POSIX-specific variant.
2020-05-31 13:30:31 +01:00
Julian M. Kunkel
5663593919
Moved generic IOR information to "hint" structure. Backends should only use the "hints" if set.
2020-05-31 12:50:03 +01:00
Julian M. Kunkel
8098c3740a
Refactored fd into aiori_fd_t for type safety.
2020-05-31 12:12:49 +01:00
Julian M. Kunkel
c4c19d3245
Fixed type typo in name.
2020-05-31 11:58:34 +01:00
Julian M. Kunkel
294b8891e6
Created dummy option type to provide type safety. Fixed various call issues for options.
2020-05-31 11:50:15 +01:00
Julian M. Kunkel
e91b79cea0
Moved Lustre/GPFS/BeeGFS options into POSIX backend. Needs testing. Additional minor fixes.
2020-05-30 20:09:37 +01:00
Julian M. Kunkel
930ccdc68d
Updated HDF5 to new module specification.
2020-05-30 19:01:20 +01:00
Julian M. Kunkel
aa9e2ad815
MDTest updated for AIORI changes.
2020-05-30 18:30:26 +01:00
Julian M. Kunkel
1890aaaeb0
Started to move IOR specific knowledge out of AIORI.
...
For now, and compatibility, IOR options can still be set/internally accessed using the backends init_xfer_options.
This should be removed in the long run to strip away this dependency.
2020-05-30 18:19:48 +01:00
Julian M. Kunkel
2de4210311
Provide a string option parser function.
2020-05-29 16:05:42 +01:00
Mark Nelson
edba70e99c
aiori-CEPHFS: don't just unmount on close, release cmount too.
...
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 20:42:26 -05:00
Mark Nelson
efc6d49832
src/aiori-CEPHFS: Add option checks before init
...
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 19:52:45 -05:00
Mark Nelson
8abb7a62dc
src/aiori-CEPHFS: Add sync
...
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 22:28:16 +00:00
Julian M. Kunkel
153b7aa60f
Critical bugfix for ior API (used e.g. in IO500)
...
TODO: Check potential issue when using IOR scripts with different backends.
2020-05-28 21:18:44 +01:00
Julian M. Kunkel
4eb0ebec55
Add dummy sync to dummy backend.
2020-05-28 21:13:45 +01:00
Julian M. Kunkel
8c92a1b2ff
Merge branch 'master' of github.com:hpc/ior
2020-05-28 20:12:06 +01:00
Julian M. Kunkel
f97090a86b
Typo fix.
2020-05-28 20:11:52 +01:00
Mohamad Chaarawi
28fae361f4
dfs: add DFS sync call
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-28 18:34:31 +00:00
Julian M. Kunkel
4b417ef1f3
IOR shouldn't fail if it cannot determine file system sizes but warn. Functionality should presumably be moved into AIORI backends.
2020-05-28 19:05:41 +01:00
Julian M. Kunkel
a536649abb
Clarified some issues in the test framework and added example test. #219
2020-05-20 17:46:35 +01:00