vitalif
/
mdtest
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
822 Commits
1 Branch
0 Tags
2.5 MiB
Commit Graph

54 Commits (master)

Author SHA1 Message Date
Peter Steinbach 61f36f0c48
converting to sphinx code snippets (#343) 
* converting to sphinx code snippets

* more rigorous code highlighting
 2021-03-09 17:07:19 +00:00
Glenn K. Lockwood 4038ebdb21 fix residual references to old main branch name 2021-02-17 12:36:20 -08:00
Julian M. Kunkel fa5b24f2aa Bugfix user docu for ranks. Bugfix missmatching barriers. 2021-02-08 13:28:13 +00:00
Glenn K. Lockwood eb883f533a update release docs based on 3.3.0 release experience 2020-12-23 18:17:47 -08:00
Glenn K. Lockwood f467903cb9
draft of a new simplified release process (#297) 2020-12-23 11:56:49 +00:00
Andreas Dilger 76d5a77ac2 Add missing options to mdtest man page 2020-11-25 01:28:07 -07:00
Karsten Weiss f280123d0b Spelling fixes (found by codespell) 2020-07-03 09:16:30 +02:00
Julian M. Kunkel c7974d194c Updated user documentation for changed odirect 2020-01-19 11:09:49 +00:00
Glenn K. Lockwood 4409082064
Merge pull request #188 from pkoutoupis/feature-global_default_dir_layout 
Enable global default dir layout for subdirs in Lustre
 2019-10-28 10:43:56 -07:00
Glenn K. Lockwood 7f4f4af215
Merge pull request #151 from haplav/patch-1 
Update tutorial.rst
 2019-10-02 13:10:16 -07:00
Mohamad Chaarawi 0d0df855e6 update user guide with IOPS and latency numbers for each iteration. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-18 19:50:43 +00:00
Petros Koutoupis 36d13d3b97 Enable global default dir layout for subdirs in Lustre 2019-09-02 22:26:12 -07:00
Glenn K. Lockwood b025d6bdb3
Merge pull request #153 from glennklockwood/docfixes 
Updated documentation
 2019-07-30 19:29:37 -05:00
Wei-keng Liao 3eb0f86640 Function ncmpi_get_file_info was first introduced in 
PnetCDF version 1.2.0. Check PnetCDF library version,
so printing MPI-IO hints can be enabled for NCMPI.
 2019-06-28 17:40:35 -05:00
Julian M. Kunkel cf197d5e38 Moved broken collectiveMetadata option into HDF5 backend module. #154 2019-05-22 10:21:18 +01:00
Glenn K. Lockwood 23106d17db forgot to RST-ify this 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 0bb96e9684 added docs for release process 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 2241f77a5d got NEWS importing correctly 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood aa3f045c92 fix spelling mistake 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 57f47db37f odds and ends 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood d0237d6d66 skript -> script 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 2333c23bed clean up intro 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 11d63f067a updated formatting 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 32f256f4ef bugfix 2019-05-19 09:40:43 -07:00
Glenn K. Lockwood 13fd0c6c16 populate sphinx doc versions automatically 2019-05-19 09:40:43 -07:00
Vaclav Hapla 13a17352ec
Update tutorial.rst 
"Defeating Page Cache" should be a heading I guess.
 2019-05-16 20:48:28 +02:00
Julian Kunkel acee84bedc
Merge pull request #88 from roblatham00/hdf5-coll-md 
HDF5: option to enable collective metadata
 2018-10-02 16:13:05 +01:00
Julian M. Kunkel 1f1e56c363 Usleep feature added according to Nathan's suggestions. 2018-09-30 10:01:21 +01:00
Rob Latham 7d2464f733 HDF5: option to enable collective metadata 
In HDF5-1.10 the library has an option to read and write the metadata of a file collectively.  One has to opt-in to this optimization with a property list but particularly at large scale it can have tremendous performance implications.

Further information:
- https://support.hdfgroup.org/HDF5/docNewFeatures/CollMDataIO/RFC-CollectiveMetadataReads.pdf
- https://support.hdfgroup.org/HDF5/doc/RM/RM_H5P.html#Property-SetAllCollMetadataOps
 2018-09-20 11:12:08 -05:00
Julian M. Kunkel be0b840ddd First attempt to describe new backend options. 2018-08-15 17:13:59 +01:00
Shane Snyder 0ca5f26e84 cleanup RADOS func names and docs 2018-08-14 16:18:35 -05:00
Jean-Yves VET 44ce8e5aaf Add backend for DDN's Infinite Memory Engine (IME) 
This patch adds the support of IME Native interface
as a new AIORI backend.
 2018-08-07 11:41:07 +01:00
Julian M. Kunkel 0f7a1f14b9 Support IO redirect from main() 2018-07-08 13:12:18 +01:00
Enno Zickler 6267203147 Doc: add tutorial, user guide and CI 
This adds a beginners tutorial and splits up the conten of the old user
guide in categories. In the developer section gets a page for the
travis-CI.
 2018-03-15 21:52:34 +01:00
Enno Zickler d5507955af Doc: Initial setup for Sphinx and Doxygen 2018-03-15 21:52:10 +01:00
Nathan Hjelm 4dc0081628 First cut at using the IOR backends for mdtest 
This commit makes changes to the AIORI backends to add support for
abstacting statfs, mkdir, rmdir, stat, and access. These new
abstractions are used by a modified mdtest. Some changes:

 - Require C99. Its 2017 and most compilers now support C11. The
   benefits of using C99 include subobject naming (for aiori backend
   structs), and fixed size integers (uint64_t). There is no reason to
   use the non-standard long long type.

 - Moved some of the aiori code into aiori.c so it can be used by both
   mdtest and ior.

 - Code cleanup of mdtest. This is mostly due to the usage of the IOR
   backends rather than a mess of #if code.

Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
 2017-10-19 15:29:12 -06:00
Oliver Steffen 738190bd79 add support for tuning BeeGFS parameters 2017-10-04 14:14:36 +02:00
Brett M. Kettering 18d6ed753a Added documenation for HDFS, S3, and S3_EMC APIs. 2015-09-04 12:46:35 -06:00
blair-crossman fc1101e450 Added in the validation I did for incompressible. Edited the USER_GUIDE 
with a section about the pitfalls of the incompressible flag.
 2015-05-29 10:48:54 -06:00
Blair Crossman 08d14e986d Added an uncompressible data packet to IOR. 
Changed how the -l option works.  Now you choose the type of datapacket
-l i  			incompressible data packets
-l incompressible  	incompressible data packets
-l timestamp 		timestamped data packets
-l t			timestamped data packets
-l offset		offset data packets
-l o			offset data packets

-G option now is either the seed for the incompressible random packets
   or the timestamp, depending on the input to the -l option.

-G will no long timestamp packets on its own without the additon of -l timestamp or -l t

I kept shorter versions of the options for the sake of typing sanity.
 2015-05-21 12:05:56 -06:00
Jeff Inman 37738dab26 Numerous changes to file-modes, small build-tweaks, and a tweak to aiori-S3.c 
(Only rank-0 should create the bucket, if it doesn't already exist.)

Prepping this for a push (as an experimental S3 build) to github.
 2015-05-19 09:36:28 -06:00
Rob Latham aa604c1d38 Teach IOR about GPFS hints (gpfs_fcntl) 
GPFS supports a "gpfs_fcntl" method for hinting various things,
including "i'm about to write this block of data".  Let's see if, for
the cost of a few system calls, we can wrangle the GPFS locking system
into allowing concurrent access with less overhead. (new IOR parameter
gpfsHintAccess)

Also, drop all locks on a file immediately after open/creation in the
shared file case, since we know all processes will touch unique regions
of the file.  It may or may not be a good idea to release all file locks
after opening.  Processes will then have to re-acquire locks already
held.   (new IOR parameter gpfsReleaseToken)
 2013-10-03 18:07:49 -07:00
Christopher J. Morrone 6251589601 Add memoryPerNode documentation 2012-01-13 15:47:59 -08:00
Christopher J. Morrone 9ac80230a4 Documentation update 2012-01-13 15:45:04 -08:00
Christopher J. Morrone 5f162061bd Change testNum to refNum 2012-01-13 15:45:02 -08:00
Christopher J. Morrone ef70266a84 Allow long summary to be printed for every test. 2012-01-13 15:43:54 -08:00
Christopher J. Morrone 8c95611125 Alphabetize the command line options 2012-01-13 15:43:47 -08:00
Christopher J. Morrone 253941fc6c Fix "make dist" 2012-01-08 20:31:01 -08:00
Christopher J. Morrone 06f65eae23 Update documentation 2012-01-08 19:43:41 -08:00
Christopher J. Morrone 349f747ea5 Remove undocumented options. 2012-01-08 19:43:41 -08:00