Commit Graph

822 Commits (master)

Author SHA1 Message Date
Julian M. Kunkel 4b417ef1f3 IOR shouldn't fail if it cannot determine file system sizes but warn. Functionality should presumably be moved into AIORI backends. 2020-05-28 19:05:41 +01:00
Julian M. Kunkel a536649abb Clarified some issues in the test framework and added example test. #219 2020-05-20 17:46:35 +01:00
Julian M. Kunkel 48eb1880e9 For better testing: Fixed fake tasks per node to work with MPI3, added environment variable to fake num nodes. 2020-04-21 10:35:53 +01:00
Julian Kunkel 8bc9a12f80
Merge pull request #221 from daos-stack/mschaara/dfs_l2g
DFS driver update to share DFS mount on init
2020-04-14 10:13:55 +01:00
Mohamad Chaarawi 1b8848ccbc Use l2g-g2l to share the dfs mount instead of opening by each rank.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-04-13 19:59:56 +00:00
Mohamad Chaarawi eed22a4aaf Look into lib64 for cart libraries too.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-04-06 21:42:51 +00:00
Julian Kunkel 3562a354ad
Merge pull request #220 from jyvet/outliers
Display outlier host names
2020-03-17 15:47:13 +00:00
Jean-Yves VET a21137be3e Display outlier host names
Display host names when using the -j argument (outlierThreshold) so
that IOR could help to better identify slow nodes:

WARNING: for client02, task 6, write elapsed transfer time is 65.738326
2020-03-17 16:31:56 +01:00
Glenn K. Lockwood 657ff8ad8f
Merge pull request #217 from markhpc/wip-aiori-cephfs
[RFC] src/aiori-CEPHFS: New libcephfs backend
2020-03-10 12:29:24 -07:00
Mark Nelson 9649a0c520 src/aiori-CEPHFS: New libcephfs backend
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-03-10 10:19:41 -05:00
Julian M. Kunkel 9726aa0ce2 Bugfix API which doesn't set the AIORI backend. 2020-03-07 14:40:59 +00:00
Julian Kunkel f5ecb9d974
Merge pull request #215 from daos-stack/daos-devel
DAOS Driver: Update License & Align with 1.0 API changes
2020-02-26 19:13:48 +00:00
Mohamad Chaarawi 50a4ba0735 DAOS Driver: Update License & Align with 1.0 API changes
- License should inherit from IOR License.
- remove checksums from Array API
- add DFS dir oclass option

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-02-26 18:53:51 +00:00
Julian Kunkel ec8d246b33
Merge pull request #214 from markhpc/wip-ior-rados-mark
src/aiori-RADOS: Remove Direct IO option check.
2020-02-26 09:06:54 +00:00
Mark Nelson e363713c07 src/aiori-RADOS: Remove Direct IO option check.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2020-02-25 18:13:29 -06:00
Julian Kunkel 371edc3e1e
Merge pull request #212 from daos-stack/jvolivie/add_runpath
Add runpath to configure script for daos and cart
2020-01-28 18:13:59 +00:00
Julian M. Kunkel c7974d194c Updated user documentation for changed odirect 2020-01-19 11:09:49 +00:00
Jeff Olivier 2a4c21e457 Add runpath to configure script for daos and cart
Enables running without setting LD_LIBRARY_PATH
Uses DT_RUNPATH (--enable-new-dtags) so that it can
be overwritten by setting LD_LIBRARY_PATH should
libraries be moved.

Signed-off-by: Jeff Olivier <jeffrey.v.olivier@intel.com>
2020-01-08 16:45:50 -07:00
Julian M. Kunkel c702a98376 Strict prototypes for AIORI 2019-12-22 11:21:40 +00:00
Julian M. Kunkel 6de5cdc6f9 Fixed wrong usage of platform, fixed printf output. 2019-12-21 14:14:27 +00:00
Julian M. Kunkel 240d5fae79 Trivial fix to ensure all functions are prototypes. 2019-12-21 11:19:02 +00:00
Julian M. Kunkel 73c5c0efc2 Fix for collective operations by Wolfgang Szoecs #210.
It does have performance implications but is only active if needed.
2019-12-19 13:43:38 +00:00
Glenn K. Lockwood b84c86bf3c
Merge pull request #209 from jyvet/ime-sync-mknod
aiori-IME: Add support of sync and mknod in IME backend
2019-12-17 09:51:09 -08:00
Jean-Yves VET 0666875df3 aiori-IME: Add support of sync and mknod in IME backend
This patch adds the support of sync (flush client page cache
for all opened files) and mknod in the IME backend.
2019-12-17 14:51:21 +01:00
Glenn K. Lockwood 7a2d307c74
Merge pull request #208 from jyvet/mknod
Fix confusing output of mknod
2019-12-16 12:38:13 -08:00
Glenn K. Lockwood e87f46fc5d
Merge pull request #207 from jyvet/compilation
Fix compilation warnings
2019-12-16 12:34:37 -08:00
Jean-Yves VET 9da36abaca Fix confusing output of mknod
Context: mknod does not return a file descriptor.
2019-12-16 14:55:26 +01:00
Jean-Yves VET be48206e5f Fix compilation warnings 2019-12-16 14:51:10 +01:00
Julian Kunkel 3a34b2efb7
Merge pull request #200 from daos-stack/daos-devel
DAOS driver update
2019-11-13 10:38:28 +00:00
Mohamad Chaarawi acfd4673cc We only need to add dirs to the Hash in the DFS driver.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-11-13 00:09:03 +00:00
Adrian Jackson ddac5c8dbf
Merge pull request #3 from hpc/master
Bring fork up to date
2019-11-12 14:20:53 +00:00
Julian Kunkel f69dfbe971
Merge pull request #201 from rldleblanc/rldleblanc/json-adds
Not sure why iops and latency are left out of the JSON job output. It…
2019-11-12 09:37:36 +00:00
Robert LeBlanc 47199e28dd Not sure why iops and latency are left out of the JSON job output. It is really useful information.
Signed-off by: Robert LeBlanc <robert@leblancnet.us>
2019-11-11 23:16:01 +00:00
Afrian Jackson 9c0926ef2a Moving fsync pmdk functionalty from persist to drain on the advice of the PMDK developers 2019-11-07 20:17:55 +00:00
Mohamad Chaarawi fbff9b6fb2 add DFS prefix option
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-11-07 18:01:07 +00:00
Mohamad Chaarawi d926bf1c90 update configure.ac to look under lib64 for DAOS libs
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-11-06 23:10:45 +00:00
Adrian Jackson 339bb200c8 Fixing configure so pmdk backend not built without --with-pmdk being specified 2019-11-05 17:44:26 +00:00
Adrian Jackson c24b2f156a
Merge pull request #2 from hpc/master
Merging in latest master changes
2019-11-05 15:00:47 +00:00
Afrian Jackson b4c85798bd Tidying up PMDK backend 2019-11-05 14:39:31 +00:00
Afrian Jackson 46c5d4e78d Adding in dual mount functionality for NVRAM within nodes 2019-11-05 14:37:54 +00:00
Glenn K. Lockwood bdfc43125a
Merge pull request #198 from daos-stack/daos-devel
fix config error with older autoconf/automake versions.
2019-11-04 15:56:44 -08:00
Mohamad Chaarawi 847b8ad408 fix config error with older autocont/automake versions.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-11-04 22:57:47 +00:00
Afrian Jackson 817603f5d1 Updating copyright statement 2019-10-31 15:31:28 +00:00
Afrian Jackson fa25c31994 Adding PMDK functionality 2019-10-31 15:29:09 +00:00
Glenn K. Lockwood 3c7ac2df23
Merge pull request #196 from daos-stack/daos-devel
update DFS driver with new DAOS API changes.
2019-10-28 16:56:29 -07:00
Glenn K. Lockwood 4409082064
Merge pull request #188 from pkoutoupis/feature-global_default_dir_layout
Enable global default dir layout for subdirs in Lustre
2019-10-28 10:43:56 -07:00
Mohamad Chaarawi 92180e022d update DFS read/write APIs with new DAOS API changes
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-10-28 16:42:44 +00:00
Adrian Jackson 3d39626e86
Merge pull request #1 from hpc/master
Merge in latest master updates
2019-10-28 14:07:10 +00:00
jschwartz-cray ccba3b11e5
Merge branch 'master' into fix-194 2019-10-23 16:46:00 -06:00
Josh Schwartz 61333af822 Fix #194.
On previous versions of IOR (and most Linux CLI applications in general)
multiple flags can be combined such as -vvv to get verbose=3 rather than
having to specify each separately as -v -v -v.  This patch fixes this behavior.

It also fixes issues around handling of the verbose flag where the
output would never be printed as we were comparing verbose < VERBOSE_0
where verbose defaults to 0 and can only increase.
2019-10-23 16:17:37 -06:00