vitalif
/
mdtest
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
581 Commits
1 Branch
0 Tags
2.5 MiB
Commit Graph

415 Commits (c105d014b28ab681a9c356800f64e588843fd92a)

Author SHA1 Message Date
Sven Breuner c828a0f32c mdtest: use correct number of bytes for posix_memalign of read buffer 
Fixes a typo in initial posix_memalign commit for DirectIO support.
 2020-06-03 01:22:44 +03:00
Sven Breuner 3eb488939d mdtest: allocate aligned buffers to support DirectIO 2020-06-03 00:30:38 +03:00
Mohamad Chaarawi 3623f3b8bd DFS: allow multiple IO phases when ior_run() is called 
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-05-31 16:20:58 +00:00
Julian M. Kunkel 2de4210311 Provide a string option parser function. 2020-05-29 16:05:42 +01:00
Mark Nelson edba70e99c aiori-CEPHFS: don't just unmount on close, release cmount too. 
Signed-off-by: Mark Nelson <mnelson@redhat.com>
 2020-05-28 20:42:26 -05:00
Mark Nelson efc6d49832 src/aiori-CEPHFS: Add option checks before init 
Signed-off-by: Mark Nelson <mnelson@redhat.com>
 2020-05-28 19:52:45 -05:00
Mark Nelson 8abb7a62dc src/aiori-CEPHFS: Add sync 
Signed-off-by: Mark Nelson <mnelson@redhat.com>
 2020-05-28 22:28:16 +00:00
Julian M. Kunkel 153b7aa60f Critical bugfix for ior API (used e.g. in IO500) 
TODO: Check potential issue when using IOR scripts with different backends.
 2020-05-28 21:18:44 +01:00
Julian M. Kunkel 4eb0ebec55 Add dummy sync to dummy backend. 2020-05-28 21:13:45 +01:00
Julian M. Kunkel 8c92a1b2ff Merge branch 'master' of github.com:hpc/ior 2020-05-28 20:12:06 +01:00
Julian M. Kunkel f97090a86b Typo fix. 2020-05-28 20:11:52 +01:00
Mohamad Chaarawi 28fae361f4 dfs: add DFS sync call 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-05-28 18:34:31 +00:00
Julian M. Kunkel 4b417ef1f3 IOR shouldn't fail if it cannot determine file system sizes but warn. Functionality should presumably be moved into AIORI backends. 2020-05-28 19:05:41 +01:00
Julian M. Kunkel a536649abb Clarified some issues in the test framework and added example test. #219 2020-05-20 17:46:35 +01:00
Julian M. Kunkel 48eb1880e9 For better testing: Fixed fake tasks per node to work with MPI3, added environment variable to fake num nodes. 2020-04-21 10:35:53 +01:00
Julian Kunkel 8bc9a12f80
Merge pull request #221 from daos-stack/mschaara/dfs_l2g 
DFS driver update to share DFS mount on init
 2020-04-14 10:13:55 +01:00
Mohamad Chaarawi 1b8848ccbc Use l2g-g2l to share the dfs mount instead of opening by each rank. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-04-13 19:59:56 +00:00
Jean-Yves VET a21137be3e Display outlier host names 
Display host names when using the -j argument (outlierThreshold) so
that IOR could help to better identify slow nodes:

WARNING: for client02, task 6, write elapsed transfer time is 65.738326
 2020-03-17 16:31:56 +01:00
Glenn K. Lockwood 657ff8ad8f
Merge pull request #217 from markhpc/wip-aiori-cephfs 
[RFC] src/aiori-CEPHFS: New libcephfs backend
 2020-03-10 12:29:24 -07:00
Mark Nelson 9649a0c520 src/aiori-CEPHFS: New libcephfs backend 
Signed-off-by: Mark Nelson <mnelson@redhat.com>
 2020-03-10 10:19:41 -05:00
Julian M. Kunkel 9726aa0ce2 Bugfix API which doesn't set the AIORI backend. 2020-03-07 14:40:59 +00:00
Julian Kunkel f5ecb9d974
Merge pull request #215 from daos-stack/daos-devel 
DAOS Driver: Update License & Align with 1.0 API changes
 2020-02-26 19:13:48 +00:00
Mohamad Chaarawi 50a4ba0735 DAOS Driver: Update License & Align with 1.0 API changes 
- License should inherit from IOR License.
- remove checksums from Array API
- add DFS dir oclass option

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-02-26 18:53:51 +00:00
Julian Kunkel ec8d246b33
Merge pull request #214 from markhpc/wip-ior-rados-mark 
src/aiori-RADOS: Remove Direct IO option check.
 2020-02-26 09:06:54 +00:00
Mark Nelson e363713c07 src/aiori-RADOS: Remove Direct IO option check. 
Signed-off-by: Mark Nelson <mnelson@redhat.com>
 2020-02-25 18:13:29 -06:00
Julian M. Kunkel c702a98376 Strict prototypes for AIORI 2019-12-22 11:21:40 +00:00
Julian M. Kunkel 6de5cdc6f9 Fixed wrong usage of platform, fixed printf output. 2019-12-21 14:14:27 +00:00
Julian M. Kunkel 240d5fae79 Trivial fix to ensure all functions are prototypes. 2019-12-21 11:19:02 +00:00
Julian M. Kunkel 73c5c0efc2 Fix for collective operations by Wolfgang Szoecs #210. 
It does have performance implications but is only active if needed.
 2019-12-19 13:43:38 +00:00
Jean-Yves VET 0666875df3 aiori-IME: Add support of sync and mknod in IME backend 
This patch adds the support of sync (flush client page cache
for all opened files) and mknod in the IME backend.
 2019-12-17 14:51:21 +01:00
Glenn K. Lockwood 7a2d307c74
Merge pull request #208 from jyvet/mknod 
Fix confusing output of mknod
 2019-12-16 12:38:13 -08:00
Jean-Yves VET 9da36abaca Fix confusing output of mknod 
Context: mknod does not return a file descriptor.
 2019-12-16 14:55:26 +01:00
Jean-Yves VET be48206e5f Fix compilation warnings 2019-12-16 14:51:10 +01:00
Julian Kunkel 3a34b2efb7
Merge pull request #200 from daos-stack/daos-devel 
DAOS driver update
 2019-11-13 10:38:28 +00:00
Mohamad Chaarawi acfd4673cc We only need to add dirs to the Hash in the DFS driver. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-11-13 00:09:03 +00:00
Robert LeBlanc 47199e28dd Not sure why iops and latency are left out of the JSON job output. It is really useful information. 
Signed-off by: Robert LeBlanc <robert@leblancnet.us>
 2019-11-11 23:16:01 +00:00
Mohamad Chaarawi fbff9b6fb2 add DFS prefix option 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-11-07 18:01:07 +00:00
Glenn K. Lockwood 3c7ac2df23
Merge pull request #196 from daos-stack/daos-devel 
update DFS driver with new DAOS API changes.
 2019-10-28 16:56:29 -07:00
Glenn K. Lockwood 4409082064
Merge pull request #188 from pkoutoupis/feature-global_default_dir_layout 
Enable global default dir layout for subdirs in Lustre
 2019-10-28 10:43:56 -07:00
Mohamad Chaarawi 92180e022d update DFS read/write APIs with new DAOS API changes 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-10-28 16:42:44 +00:00
Julian Kunkel b334c3f6fd
Merge pull request #192 from daos-stack/daos-devel 
fix -R option to do proper data verification
 2019-10-16 16:20:43 +01:00
Mohamad Chaarawi dc82a1bf2f ior -R should memset the buffer being read, otherwise a read that does nothing 
will report success in the data verification phase.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-10-16 14:54:00 +00:00
Julian M. Kunkel a69a5916cf Hotfix for ior -F -u 2019-10-16 09:42:10 +01:00
Glenn K. Lockwood f40b0744ff
Merge pull request #187 from daos-stack/daos-devel 
IOR: Add latency and IOPS numbers to each iteration.
 2019-10-02 13:09:26 -07:00
Petros Koutoupis b3ecd756ce Implemented AC_CHECK_HEADERS fix in style of #190 2019-09-30 04:25:59 -07:00
Mohamad Chaarawi 2aea04c8cb fix some compiler warnings. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-21 22:43:20 +00:00
Mohamad Chaarawi fca0a62ccb update to new DAOS API for creating dfs containers. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-21 22:05:54 +00:00
Julian Kunkel 604598ab2f
Merge pull request #182 from jschwartz-cray/fix-181 
Fix #181.
 2019-09-19 16:53:41 +01:00
Mohamad Chaarawi 12284ae04a Add latency and iops numbers to each iteration. 
- Latency reported is computed by taking the average latency of
  all ops from a single task, then taking the minimum of that
  between all tasks.

- IOPS is computed by taking the total number of ops across all
  tasks divided by the total access time to execute those ops.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-10 18:49:32 +00:00
Mohamad Chaarawi c58ba8ffb5 add break that was accidentally removed 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-10 14:11:55 +00:00