Commit Graph

664 Commits (0e9176932836bb11f75fe212ca6c94f7a83d052a)

Author SHA1 Message Date
Julian M. Kunkel 38b1752bda JSON issue with results. Fix for #233. 2020-06-25 14:37:52 +01:00
Julian M. Kunkel 0bffd14de7 Added --warningAsErrors option to IOR and MDTest and refactored WARNINGs in IOR. #174 2020-06-24 11:13:12 +01:00
Julian M. Kunkel c55848f14d Bugfix based on the pull request for fix-189. Should fix #189. 2020-06-24 10:15:31 +01:00
Julian Kunkel 71874f9b90
Merge pull request #199 from adrianjhpc/master
PMDK backend with dual mount options
2020-06-24 09:50:12 +01:00
Julian Kunkel d5de9bcc77
Merge branch 'master' into master 2020-06-24 09:50:03 +01:00
Julian Kunkel 8faa6c88d6
Merge pull request #195 from jschwartz-cray/fix-194
Fix #194.
2020-06-24 09:43:56 +01:00
Julian Kunkel 6a88b37171
Merge branch 'master' into fix-194 2020-06-24 09:43:37 +01:00
Julian Kunkel 6e507f732c
Merge pull request #225 from hpc/fix-modules
Improve AIORI module behavior
2020-06-24 09:26:19 +01:00
Julian M. Kunkel c105d014b2 Increased version number in preparation of a new release. 2020-06-24 09:23:01 +01:00
Julian Kunkel d483e3bf9d
Merge branch 'rc' into master 2020-06-24 08:58:08 +01:00
Julian Kunkel 39ca1f25fe
Merge pull request #230 from mchaarawi/fix-modules
merge from master
2020-06-11 21:05:52 +01:00
Mohamad Chaarawi b4a54c34e8 Merge branch 'master' into fix-modules
Conflicts:
	src/aiori-DAOS.c
	src/aiori-DFS.c
2020-06-11 19:55:23 +00:00
Julian Kunkel 825dcef337
Merge pull request #229 from mchaarawi/fix-modules
update DFS and DAOS drivers to new aiori module interface.
2020-06-11 20:03:33 +01:00
Mohamad Chaarawi e08314f571 update DFS and DAOS drivers to new aiori module interface.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-06-11 17:26:58 +00:00
Julian M. Kunkel eb2cd27fac Removed offset from IOR structure. 2020-06-10 17:47:07 +01:00
Glenn K. Lockwood d4d3c72efb
Merge pull request #228 from breuner/fix-mdtest-directio
mdtest: use correct number of bytes for posix_memalign of read buffer
2020-06-02 16:22:58 -07:00
Sven Breuner c828a0f32c mdtest: use correct number of bytes for posix_memalign of read buffer
Fixes a typo in initial posix_memalign commit for DirectIO support.
2020-06-03 01:22:44 +03:00
Glenn K. Lockwood 9f07265d1e
Merge pull request #227 from breuner/fix-mdtest-directio
mdtest: allocate aligned buffers to support DirectIO
2020-06-02 15:06:50 -07:00
Sven Breuner 3eb488939d mdtest: allocate aligned buffers to support DirectIO 2020-06-03 00:30:38 +03:00
Julian Kunkel a369d94037
Merge pull request #226 from mchaarawi/master
DFS: allow multiple IO phases when ior_run() is called
2020-06-01 09:50:12 +01:00
Mohamad Chaarawi 3623f3b8bd DFS: allow multiple IO phases when ior_run() is called
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-31 16:20:58 +00:00
Julian M. Kunkel 8fa8ef0c02 Call backend statfs() instead of only POSIX-specific variant. 2020-05-31 13:30:31 +01:00
Julian M. Kunkel 5663593919 Moved generic IOR information to "hint" structure. Backends should only use the "hints" if set. 2020-05-31 12:50:03 +01:00
Julian M. Kunkel 8098c3740a Refactored fd into aiori_fd_t for type safety. 2020-05-31 12:12:49 +01:00
Julian M. Kunkel c4c19d3245 Fixed type typo in name. 2020-05-31 11:58:34 +01:00
Julian M. Kunkel 294b8891e6 Created dummy option type to provide type safety. Fixed various call issues for options. 2020-05-31 11:50:15 +01:00
Julian M. Kunkel e91b79cea0 Moved Lustre/GPFS/BeeGFS options into POSIX backend. Needs testing. Additional minor fixes. 2020-05-30 20:09:37 +01:00
Julian M. Kunkel 930ccdc68d Updated HDF5 to new module specification. 2020-05-30 19:01:20 +01:00
Julian M. Kunkel aa9e2ad815 MDTest updated for AIORI changes. 2020-05-30 18:30:26 +01:00
Julian M. Kunkel 1890aaaeb0 Started to move IOR specific knowledge out of AIORI.
For now, and compatibility, IOR options can still be set/internally accessed using the backends init_xfer_options.
This should be removed in the long run to strip away this dependency.
2020-05-30 18:19:48 +01:00
Julian M. Kunkel 2de4210311 Provide a string option parser function. 2020-05-29 16:05:42 +01:00
Julian Kunkel 314871e92d
Merge pull request #224 from markhpc/wip-aiori-cephfs-checks
src/aiori-CEPHFS: Option warnings, shutdown checks, and cmount nullification
2020-05-29 10:13:15 +01:00
Mark Nelson edba70e99c aiori-CEPHFS: don't just unmount on close, release cmount too.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 20:42:26 -05:00
Mark Nelson efc6d49832 src/aiori-CEPHFS: Add option checks before init
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 19:52:45 -05:00
Julian Kunkel 2711ae5257
Merge pull request #223 from markhpc/wip-aiori-cephfs-sync
src/aiori-CEPHFS: Add sync
2020-05-29 00:23:52 +01:00
Mark Nelson 8abb7a62dc src/aiori-CEPHFS: Add sync
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-05-28 22:28:16 +00:00
Julian M. Kunkel 153b7aa60f Critical bugfix for ior API (used e.g. in IO500)
TODO: Check potential issue when using IOR scripts with different backends.
2020-05-28 21:18:44 +01:00
Julian M. Kunkel 4eb0ebec55 Add dummy sync to dummy backend. 2020-05-28 21:13:45 +01:00
Julian M. Kunkel 8c92a1b2ff Merge branch 'master' of github.com:hpc/ior 2020-05-28 20:12:06 +01:00
Julian M. Kunkel f97090a86b Typo fix. 2020-05-28 20:11:52 +01:00
Julian Kunkel 691fc4bf6f
Merge pull request #222 from mchaarawi/master
dfs: add DFS sync call
2020-05-28 20:10:58 +01:00
Mohamad Chaarawi 28fae361f4 dfs: add DFS sync call
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-05-28 18:34:31 +00:00
Julian M. Kunkel 4b417ef1f3 IOR shouldn't fail if it cannot determine file system sizes but warn. Functionality should presumably be moved into AIORI backends. 2020-05-28 19:05:41 +01:00
Julian M. Kunkel a536649abb Clarified some issues in the test framework and added example test. #219 2020-05-20 17:46:35 +01:00
Julian M. Kunkel 48eb1880e9 For better testing: Fixed fake tasks per node to work with MPI3, added environment variable to fake num nodes. 2020-04-21 10:35:53 +01:00
Julian Kunkel 8bc9a12f80
Merge pull request #221 from daos-stack/mschaara/dfs_l2g
DFS driver update to share DFS mount on init
2020-04-14 10:13:55 +01:00
Mohamad Chaarawi 1b8848ccbc Use l2g-g2l to share the dfs mount instead of opening by each rank.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-04-13 19:59:56 +00:00
Mohamad Chaarawi eed22a4aaf Look into lib64 for cart libraries too.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-04-06 21:42:51 +00:00
Julian Kunkel 3562a354ad
Merge pull request #220 from jyvet/outliers
Display outlier host names
2020-03-17 15:47:13 +00:00
Jean-Yves VET a21137be3e Display outlier host names
Display host names when using the -j argument (outlierThreshold) so
that IOR could help to better identify slow nodes:

WARNING: for client02, task 6, write elapsed transfer time is 65.738326
2020-03-17 16:31:56 +01:00