Julian M. Kunkel
48eb1880e9
For better testing: Fixed fake tasks per node to work with MPI3, added environment variable to fake num nodes.
2020-04-21 10:35:53 +01:00
Julian Kunkel
8bc9a12f80
Merge pull request #221 from daos-stack/mschaara/dfs_l2g
...
DFS driver update to share DFS mount on init
2020-04-14 10:13:55 +01:00
Mohamad Chaarawi
1b8848ccbc
Use l2g-g2l to share the dfs mount instead of opening by each rank.
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-04-13 19:59:56 +00:00
Jean-Yves VET
a21137be3e
Display outlier host names
...
Display host names when using the -j argument (outlierThreshold) so
that IOR could help to better identify slow nodes:
WARNING: for client02, task 6, write elapsed transfer time is 65.738326
2020-03-17 16:31:56 +01:00
Glenn K. Lockwood
657ff8ad8f
Merge pull request #217 from markhpc/wip-aiori-cephfs
...
[RFC] src/aiori-CEPHFS: New libcephfs backend
2020-03-10 12:29:24 -07:00
Mark Nelson
9649a0c520
src/aiori-CEPHFS: New libcephfs backend
...
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-03-10 10:19:41 -05:00
Julian M. Kunkel
9726aa0ce2
Bugfix API which doesn't set the AIORI backend.
2020-03-07 14:40:59 +00:00
Julian Kunkel
f5ecb9d974
Merge pull request #215 from daos-stack/daos-devel
...
DAOS Driver: Update License & Align with 1.0 API changes
2020-02-26 19:13:48 +00:00
Mohamad Chaarawi
50a4ba0735
DAOS Driver: Update License & Align with 1.0 API changes
...
- License should inherit from IOR License.
- remove checksums from Array API
- add DFS dir oclass option
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-02-26 18:53:51 +00:00
Julian Kunkel
ec8d246b33
Merge pull request #214 from markhpc/wip-ior-rados-mark
...
src/aiori-RADOS: Remove Direct IO option check.
2020-02-26 09:06:54 +00:00
Mark Nelson
e363713c07
src/aiori-RADOS: Remove Direct IO option check.
...
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-02-25 18:13:29 -06:00
Julian M. Kunkel
c702a98376
Strict prototypes for AIORI
2019-12-22 11:21:40 +00:00
Julian M. Kunkel
6de5cdc6f9
Fixed wrong usage of platform, fixed printf output.
2019-12-21 14:14:27 +00:00
Julian M. Kunkel
240d5fae79
Trivial fix to ensure all functions are prototypes.
2019-12-21 11:19:02 +00:00
Julian M. Kunkel
73c5c0efc2
Fix for collective operations by Wolfgang Szoecs #210 .
...
It does have performance implications but is only active if needed.
2019-12-19 13:43:38 +00:00
Jean-Yves VET
0666875df3
aiori-IME: Add support of sync and mknod in IME backend
...
This patch adds the support of sync (flush client page cache
for all opened files) and mknod in the IME backend.
2019-12-17 14:51:21 +01:00
Glenn K. Lockwood
7a2d307c74
Merge pull request #208 from jyvet/mknod
...
Fix confusing output of mknod
2019-12-16 12:38:13 -08:00
Jean-Yves VET
9da36abaca
Fix confusing output of mknod
...
Context: mknod does not return a file descriptor.
2019-12-16 14:55:26 +01:00
Jean-Yves VET
be48206e5f
Fix compilation warnings
2019-12-16 14:51:10 +01:00
Julian Kunkel
3a34b2efb7
Merge pull request #200 from daos-stack/daos-devel
...
DAOS driver update
2019-11-13 10:38:28 +00:00
Mohamad Chaarawi
acfd4673cc
We only need to add dirs to the Hash in the DFS driver.
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-11-13 00:09:03 +00:00
Robert LeBlanc
47199e28dd
Not sure why iops and latency are left out of the JSON job output. It is really useful information.
...
Signed-off by: Robert LeBlanc <robert@leblancnet.us>
2019-11-11 23:16:01 +00:00
Mohamad Chaarawi
fbff9b6fb2
add DFS prefix option
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-11-07 18:01:07 +00:00
Glenn K. Lockwood
3c7ac2df23
Merge pull request #196 from daos-stack/daos-devel
...
update DFS driver with new DAOS API changes.
2019-10-28 16:56:29 -07:00
Glenn K. Lockwood
4409082064
Merge pull request #188 from pkoutoupis/feature-global_default_dir_layout
...
Enable global default dir layout for subdirs in Lustre
2019-10-28 10:43:56 -07:00
Mohamad Chaarawi
92180e022d
update DFS read/write APIs with new DAOS API changes
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-10-28 16:42:44 +00:00
Julian Kunkel
b334c3f6fd
Merge pull request #192 from daos-stack/daos-devel
...
fix -R option to do proper data verification
2019-10-16 16:20:43 +01:00
Mohamad Chaarawi
dc82a1bf2f
ior -R should memset the buffer being read, otherwise a read that does nothing
...
will report success in the data verification phase.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-10-16 14:54:00 +00:00
Julian M. Kunkel
a69a5916cf
Hotfix for ior -F -u
2019-10-16 09:42:10 +01:00
Glenn K. Lockwood
f40b0744ff
Merge pull request #187 from daos-stack/daos-devel
...
IOR: Add latency and IOPS numbers to each iteration.
2019-10-02 13:09:26 -07:00
Petros Koutoupis
b3ecd756ce
Implemented AC_CHECK_HEADERS fix in style of #190
2019-09-30 04:25:59 -07:00
Mohamad Chaarawi
2aea04c8cb
fix some compiler warnings.
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-21 22:43:20 +00:00
Mohamad Chaarawi
fca0a62ccb
update to new DAOS API for creating dfs containers.
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-21 22:05:54 +00:00
Julian Kunkel
604598ab2f
Merge pull request #182 from jschwartz-cray/fix-181
...
Fix #181 .
2019-09-19 16:53:41 +01:00
Mohamad Chaarawi
12284ae04a
Add latency and iops numbers to each iteration.
...
- Latency reported is computed by taking the average latency of
all ops from a single task, then taking the minimum of that
between all tasks.
- IOPS is computed by taking the total number of ops across all
tasks divided by the total access time to execute those ops.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-10 18:49:32 +00:00
Mohamad Chaarawi
c58ba8ffb5
add break that was accidentally removed
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-10 14:11:55 +00:00
Mohamad Chaarawi
fe9d76ddf3
fix segfault when no API is specified to mdtest
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-09 22:03:55 +00:00
Mohamad Chaarawi
73dbda09c6
remove printf added
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-09 20:19:42 +00:00
Mohamad Chaarawi
5622aabf46
missed Makefile.am update
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-09 20:14:12 +00:00
Mohamad Chaarawi
d332d586bf
remove uneeded code and doc
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-09 20:07:55 +00:00
Mohamad Chaarawi
e9dd5fe15e
Merge branch 'master' into daos-devel
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
Conflicts:
configure.ac
src/Makefile.am
src/aiori-MPIIO.c
src/aiori.c
src/aiori.h
src/ior.c
src/mdtest.c
src/option.c
2019-09-09 19:55:56 +00:00
Mohamad Chaarawi
57a16ddda8
- update debugging error checking in DFS.
...
- remove usleep() before daos_fini()
- fix README
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-09 19:14:35 +00:00
Julian Kunkel
0921556456
Merge pull request #184 from hpc/feature-aiori
...
Feature aiori
2019-09-09 15:20:43 +01:00
Petros Koutoupis
36d13d3b97
Enable global default dir layout for subdirs in Lustre
2019-09-02 22:26:12 -07:00
Julian M. Kunkel
c83edfe39b
Extracted check function into aiori. #24 . #177
2019-09-01 15:59:52 +01:00
Julian Kunkel
ced9b0183f
Merge pull request #172 from hpc/fix-168
...
Fix #168
2019-09-01 15:51:44 +01:00
Julian Kunkel
151102ff8f
Merge pull request #176 from otatebe/master
...
abstract I/O interface for Gfarm file system
2019-09-01 15:51:16 +01:00
Julian M. Kunkel
e3db1759b2
Moded sync() to aiori backend.
2019-09-01 15:47:42 +01:00
Julian M. Kunkel
6de1ea3176
Merge branch 'feature-sync' into feature-aiori
2019-09-01 15:39:49 +01:00
Julian M. Kunkel
60a641f911
sync help corrected.
2019-09-01 15:29:12 +01:00