Commit Graph

581 Commits (c105d014b28ab681a9c356800f64e588843fd92a)

Author SHA1 Message Date
Mohamad Chaarawi c35f64237f initialize data and akey checksum to NULL since they are not being used.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-03-14 16:55:54 +00:00
Julian Kunkel b22a39887a
Merge pull request #133 from DDNStorage/master
Enable IME native backend with mdtest. As Glenn also found it OK, I do too, there is a minor issue with the aiori backend, but well. For later.
2019-03-11 14:30:24 +00:00
Mohamad Chaarawi db19141c19 remove usage of GURT's D_GOTO from DFS plugin.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-03-01 20:41:01 +00:00
Jean-Yves VET 110153cf3a mdtest: Enable IME native interface
This patch makes mdtest allow IME native interface.
It also defines a generic way to enable mdtest with each
backend.
2019-02-12 15:50:51 +01:00
Jean-Yves VET c6abf85378 aiori-IME: Add support of statfs in IME backend
This patch adds the support of statfs in the IME backend.
It uses ime_native_statvfs call to fill the ior_aiori_statfs_t
structure.
2019-02-11 15:00:18 +01:00
Mohamad Chaarawi 29090df283 update DAOS and DFS drivers with new DAOS API changes.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-02-08 18:00:33 +00:00
Glenn K. Lockwood 8996f5494f add malloc check to fix 2019-02-07 12:59:10 -08:00
Julian M. Kunkel b561f60702 Potential fix for #127 => Segmentation fault due to memory protection. 2019-02-07 12:59:07 -08:00
Mohamad Chaarawi 2c87b5e0f5 Merge remote-tracking branch 'upstream/master' into daos
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest-main.c
	src/mdtest.c
	src/option.c
2019-01-24 00:31:12 +00:00
Glenn K. Lockwood 4c1c73ecae add malloc check to fix 2019-01-23 16:02:58 -08:00
Julian M. Kunkel 20bb99e1b7 Potential fix for #127 => Segmentation fault due to memory protection. 2019-01-19 17:00:49 +00:00
Mohamad Chaarawi 334bf73797 remove transaction commit and options to do that.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-01-17 20:58:58 +00:00
Mohamad Chaarawi d2a0023765 remove epoch usage and rebase with latest DAOS API that switches to transactions.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-01-07 18:28:59 +00:00
Glenn K. Lockwood e71cded6c3
Merge pull request #124 from hpc/fix-hdf5
Bugfix for HDF5 plugin; readded collective_md.
2019-01-02 10:01:56 -08:00
Glenn K. Lockwood a9385f4e11
Merge pull request #123 from hpc/fix-112
Fix 112 + new feature to compare patterns.
2019-01-02 10:01:26 -08:00
Julian M. Kunkel 1dbca5c293 Bugfix for HDF5 plugin; readded collective_md. 2018-12-23 13:07:23 +00:00
Glenn K. Lockwood 4b443994cb
Merge pull request #121 from glennklockwood/rc
cherry-pick solution to #119 into rc branch
2018-12-22 20:28:03 -08:00
Julian M. Kunkel 4d3d06da7a New testing framework for mdtest. The framework compares the observed with the expected pattern for the runs. For a new test, the pattern is recorded. Note that the tests are enumerated. 2018-12-20 21:09:34 +00:00
Julian M. Kunkel ed421bcc7b Fixes that issue. Hopefully works for all combinations. 2018-12-20 21:08:55 +00:00
Julian M. Kunkel dced60b060 Added test for bug #112. 2018-12-20 20:40:53 +00:00
Julian M. Kunkel cb40c99e1b Reset stonewall timer to make it work again with running all phases in one execution; i.e. not using multiple runs specifying: -C, -r 2018-12-19 15:26:23 -08:00
Julian M. Kunkel aafdf897ff Bugfix for stonewall computation. 2018-12-19 15:25:38 -08:00
Glenn K. Lockwood 1b28a64234
Merge pull request #120 from hpc/fix-119
Reset stonewall timer to make it work again with running all phases
2018-12-19 15:09:05 -08:00
Julian M. Kunkel 7b603bc5a9 Reset stonewall timer to make it work again with running all phases in one execution; i.e. not using multiple runs specifying: -C, -r 2018-12-19 21:37:37 +00:00
Julian M. Kunkel 4297ccd7f2 Bugfix for stonewall computation. 2018-12-19 20:29:47 +00:00
Andreas Dilger 1ee2c37ef0 lustre: fix checks for lustre_user.h header
Fix the configure check if --with-lustre is specified, but
the linux/lustre/lustre_user.h header is not present.  Only
one of the headers needs to be included if both are found.

In some cases, FASYNC is not defined, but forms part of the
O_LOV_DELAY_CREATE value, add a #define in that case.

Fixes #115.

Fixes: cb88c4c19a831d94b864c49a162e2635730540e5
Signed-off-by: Andreas Dilger <adilger@dilger.ca>
2018-12-14 16:46:05 -08:00
Glenn K. Lockwood 741031312d
Merge pull request #116 from adilger/b_lustre_user
lustre: fix checks for lustre_user.h header
2018-12-14 16:17:24 -08:00
Andreas Dilger 1f217ae48c lustre: fix checks for lustre_user.h header
Fix the configure check if --with-lustre is specified, but
the linux/lustre/lustre_user.h header is not present.  Only
one of the headers needs to be included if both are found.

In some cases, FASYNC is not defined, but forms part of the
O_LOV_DELAY_CREATE value, add a #define in that case.

Fixes #115.

Fixes: cb88c4c19a831d94b864c49a162e2635730540e5
Signed-off-by: Andreas Dilger <adilger@dilger.ca>
2018-12-14 16:45:43 -07:00
Mohamad Chaarawi 72c487013a rebase with latest DAOS
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2018-12-04 22:59:15 +00:00
Glenn K. Lockwood c9151d7495 merge RC for 3.2 back into master 2018-12-04 13:33:11 -08:00
Glenn K. Lockwood 11469ac5a9 updated NEWS for final contributions to 3.2 release 2018-12-04 13:08:07 -08:00
Glenn K. Lockwood e1158daaf2
Merge pull request #105 from hpc/feature-test-scripts-85
Dry-run option to test the configuration / scripts.
2018-12-04 15:06:47 -06:00
Julian M. Kunkel e045c6024e Reverted the change to HDF5 module back. 2018-12-04 12:59:17 -08:00
Julian M. Kunkel 4aada0a32f Updated docu for the changed behavior. 2018-12-04 12:59:12 -08:00
Julian M. Kunkel fec0645c04 Changed the parser.
The parser now supports concurrent parsing of all plugin options.
Moved HDF5 collective_md option into the backend as an example.
Example: ./src/ior -a dummy --dummy.delay-xfer=50000
2018-12-04 12:58:47 -08:00
Rob Latham efaa0c411a HDF5: option to enable collective metadata
In HDF5-1.10 the library has an option to read and write the metadata of a file collectively.  One has to opt-in to this optimization with a property list but particularly at large scale it can have tremendous performance implications.

Further information:
- https://support.hdfgroup.org/HDF5/docNewFeatures/CollMDataIO/RFC-CollectiveMetadataReads.pdf
- https://support.hdfgroup.org/HDF5/doc/RM/RM_H5P.html#Property-SetAllCollMetadataOps
2018-12-04 12:54:05 -08:00
Glenn K. Lockwood 5e2e1cc96f
Merge pull request #104 from hpc/feature-hdf5-backend
Changed the parser to fix #98.  Does _not_ yet have the HDF5 backend args updated.  They were reverted to allow this to make the 3.2 release and should be re-applied as a separate commit.
2018-12-04 14:41:31 -06:00
Glenn K. Lockwood 5c847f552a
Merge pull request #110 from hpc/fix-gnu99-101
Moved _XOPEN_SOURCE to config.h; resolves #93
2018-12-04 14:13:16 -06:00
Julian M. Kunkel 7db8ffd8ab Reverted the change to HDF5 module back. 2018-12-04 19:16:41 +00:00
Julian Kunkel 71fb1ceae8
Merge pull request #113 from wangshilong/master
mdtest: fix calculation for barriers
2018-11-24 11:53:21 +00:00
Wang Shilong 8902bc8722 mdtest: fix calculation for barriers
Currently, calculation for barriers case looks a bit
suprising, for example, Min stats is from min of
Max value of number of mpi proc, this makes Min
and Max very similar in our testing thus we get
a small Std value too.

I am not a MPI expert, but question is why we
don't use more nature calcuation which calculate
all results from different iterations and MPI proc?

Signed-off-by: Wang Shilong <wshilong@ddn.com>
2018-11-22 19:57:32 +08:00
Julian M. Kunkel 5a8071fbd8 GNU99 extracted _XOPEN_SOURCE to config.h. 2018-10-28 18:34:22 +00:00
Julian Kunkel 3a4f2ea33e
Merge pull request #101 from glennklockwood/issue93-squashed
compile correctly with -std=c99
2018-10-28 18:16:52 +00:00
Julian M. Kunkel f49a7e32fc Bugfix #106 mostly. 2018-10-19 11:07:26 -07:00
Julian M. Kunkel de5c5fe314 Fix computation when using branching factor with -n and -i. 2018-10-19 11:07:15 -07:00
Julian M. Kunkel b4cd1180cd Bugfix initialize the variable to zero for proper API usage. 2018-10-19 11:07:08 -07:00
Julian Kunkel 52182afed6
Merge pull request #108 from hpc/fix-106
Fix 106
2018-10-19 11:06:05 +01:00
Glenn K. Lockwood 43259d4fd6
Merge pull request #107 from marcvef/gettimestamp_mdtest
mdtest: Use IOR's GetTimeStamp() instead of MPI_Wtime()
2018-10-18 17:07:10 -07:00
Julian M. Kunkel ea3aeea964 Bugfix initialize the variable to zero for proper API usage. 2018-10-17 16:16:46 +01:00
Julian M. Kunkel 6b0b1a9830 Fix computation when using branching factor with -n and -i. 2018-10-17 16:04:49 +01:00