Commit Graph

447 Commits (f280123d0b08c7f54987a33f3209c20d8e288b1f)

Author SHA1 Message Date
Karsten Weiss f280123d0b Spelling fixes (found by codespell) 2020-07-03 09:16:30 +02:00
Julian M. Kunkel 5a5b90cdaa Run existing check to allow only supported backends in mdtest. 2020-06-30 11:17:46 +01:00
Julian M. Kunkel 3e6bfd2db7 Added missing header info. 2020-06-29 20:58:45 +01:00
Julian M. Kunkel 03dbb20594 MDTest changed verification pattern. Read now always checks the first byte/8 bytes for the signature (item number).
Added also --verify-write option which performs a read immediately after a write. Supports #206
2020-06-29 20:15:14 +01:00
Julian M. Kunkel df3f7082d8 MDTest: Added warnings/errors for errorneous read pattern #206 2020-06-28 17:21:24 +01:00
Julian M. Kunkel 145c71f7c3 Trivial cleanup: Extracted debug-related stuff into new header. 2020-06-28 17:16:56 +01:00
Julian M. Kunkel 38b1752bda JSON issue with results. Fix for #233. 2020-06-25 14:37:52 +01:00
Julian M. Kunkel 0bffd14de7 Added --warningAsErrors option to IOR and MDTest and refactored WARNINGs in IOR. #174 2020-06-24 11:13:12 +01:00
Julian M. Kunkel c55848f14d Bugfix based on the pull request for fix-189. Should fix #189. 2020-06-24 10:15:31 +01:00
Julian Kunkel d5de9bcc77
Merge branch 'master' into master 2020-06-24 09:50:03 +01:00
Julian Kunkel 6a88b37171
Merge branch 'master' into fix-194 2020-06-24 09:43:37 +01:00
Mohamad Chaarawi b4a54c34e8 Merge branch 'master' into fix-modules
Conflicts:
	src/aiori-DAOS.c
	src/aiori-DFS.c
2020-06-11 19:55:23 +00:00
Mohamad Chaarawi e08314f571 update DFS and DAOS drivers to new aiori module interface.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-06-11 17:26:58 +00:00
Julian M. Kunkel eb2cd27fac Removed offset from IOR structure. 2020-06-10 17:47:07 +01:00
Sven Breuner c828a0f32c mdtest: use correct number of bytes for posix_memalign of read buffer
Fixes a typo in initial posix_memalign commit for DirectIO support.
2020-06-03 01:22:44 +03:00
Sven Breuner 3eb488939d mdtest: allocate aligned buffers to support DirectIO 2020-06-03 00:30:38 +03:00
Mohamad Chaarawi 3623f3b8bd DFS: allow multiple IO phases when ior_run() is called
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-31 16:20:58 +00:00
Julian M. Kunkel 8fa8ef0c02 Call backend statfs() instead of only POSIX-specific variant. 2020-05-31 13:30:31 +01:00
Julian M. Kunkel 5663593919 Moved generic IOR information to "hint" structure. Backends should only use the "hints" if set. 2020-05-31 12:50:03 +01:00
Julian M. Kunkel 8098c3740a Refactored fd into aiori_fd_t for type safety. 2020-05-31 12:12:49 +01:00
Julian M. Kunkel c4c19d3245 Fixed type typo in name. 2020-05-31 11:58:34 +01:00
Julian M. Kunkel 294b8891e6 Created dummy option type to provide type safety. Fixed various call issues for options. 2020-05-31 11:50:15 +01:00
Julian M. Kunkel e91b79cea0 Moved Lustre/GPFS/BeeGFS options into POSIX backend. Needs testing. Additional minor fixes. 2020-05-30 20:09:37 +01:00
Julian M. Kunkel 930ccdc68d Updated HDF5 to new module specification. 2020-05-30 19:01:20 +01:00
Julian M. Kunkel aa9e2ad815 MDTest updated for AIORI changes. 2020-05-30 18:30:26 +01:00
Julian M. Kunkel 1890aaaeb0 Started to move IOR specific knowledge out of AIORI.
For now, and compatibility, IOR options can still be set/internally accessed using the backends init_xfer_options.
This should be removed in the long run to strip away this dependency.
2020-05-30 18:19:48 +01:00
Julian M. Kunkel 2de4210311 Provide a string option parser function. 2020-05-29 16:05:42 +01:00
Mark Nelson edba70e99c aiori-CEPHFS: don't just unmount on close, release cmount too.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 20:42:26 -05:00
Mark Nelson efc6d49832 src/aiori-CEPHFS: Add option checks before init
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 19:52:45 -05:00
Mark Nelson 8abb7a62dc src/aiori-CEPHFS: Add sync
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 22:28:16 +00:00
Julian M. Kunkel 153b7aa60f Critical bugfix for ior API (used e.g. in IO500)
TODO: Check potential issue when using IOR scripts with different backends.
2020-05-28 21:18:44 +01:00
Julian M. Kunkel 4eb0ebec55 Add dummy sync to dummy backend. 2020-05-28 21:13:45 +01:00
Julian M. Kunkel 8c92a1b2ff Merge branch 'master' of github.com:hpc/ior 2020-05-28 20:12:06 +01:00
Julian M. Kunkel f97090a86b Typo fix. 2020-05-28 20:11:52 +01:00
Mohamad Chaarawi 28fae361f4 dfs: add DFS sync call
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-28 18:34:31 +00:00
Julian M. Kunkel 4b417ef1f3 IOR shouldn't fail if it cannot determine file system sizes but warn. Functionality should presumably be moved into AIORI backends. 2020-05-28 19:05:41 +01:00
Julian M. Kunkel a536649abb Clarified some issues in the test framework and added example test. #219 2020-05-20 17:46:35 +01:00
Julian M. Kunkel 48eb1880e9 For better testing: Fixed fake tasks per node to work with MPI3, added environment variable to fake num nodes. 2020-04-21 10:35:53 +01:00
Julian Kunkel 8bc9a12f80
Merge pull request #221 from daos-stack/mschaara/dfs_l2g
DFS driver update to share DFS mount on init
2020-04-14 10:13:55 +01:00
Mohamad Chaarawi 1b8848ccbc Use l2g-g2l to share the dfs mount instead of opening by each rank.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-04-13 19:59:56 +00:00
Jean-Yves VET a21137be3e Display outlier host names
Display host names when using the -j argument (outlierThreshold) so
that IOR could help to better identify slow nodes:

WARNING: for client02, task 6, write elapsed transfer time is 65.738326
2020-03-17 16:31:56 +01:00
Glenn K. Lockwood 657ff8ad8f
Merge pull request #217 from markhpc/wip-aiori-cephfs
[RFC] src/aiori-CEPHFS: New libcephfs backend
2020-03-10 12:29:24 -07:00
Mark Nelson 9649a0c520 src/aiori-CEPHFS: New libcephfs backend
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-03-10 10:19:41 -05:00
Julian M. Kunkel 9726aa0ce2 Bugfix API which doesn't set the AIORI backend. 2020-03-07 14:40:59 +00:00
Julian Kunkel f5ecb9d974
Merge pull request #215 from daos-stack/daos-devel
DAOS Driver: Update License & Align with 1.0 API changes
2020-02-26 19:13:48 +00:00
Mohamad Chaarawi 50a4ba0735 DAOS Driver: Update License & Align with 1.0 API changes
- License should inherit from IOR License.
- remove checksums from Array API
- add DFS dir oclass option

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-02-26 18:53:51 +00:00
Julian Kunkel ec8d246b33
Merge pull request #214 from markhpc/wip-ior-rados-mark
src/aiori-RADOS: Remove Direct IO option check.
2020-02-26 09:06:54 +00:00
Mark Nelson e363713c07 src/aiori-RADOS: Remove Direct IO option check.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-02-25 18:13:29 -06:00
Julian M. Kunkel c702a98376 Strict prototypes for AIORI 2019-12-22 11:21:40 +00:00
Julian M. Kunkel 6de5cdc6f9 Fixed wrong usage of platform, fixed printf output. 2019-12-21 14:14:27 +00:00