Julian M. Kunkel
c7974d194c
Updated user documentation for changed odirect
2020-01-19 11:09:49 +00:00
Glenn K. Lockwood
4409082064
Merge pull request #188 from pkoutoupis/feature-global_default_dir_layout
...
Enable global default dir layout for subdirs in Lustre
2019-10-28 10:43:56 -07:00
Glenn K. Lockwood
7f4f4af215
Merge pull request #151 from haplav/patch-1
...
Update tutorial.rst
2019-10-02 13:10:16 -07:00
Mohamad Chaarawi
0d0df855e6
update user guide with IOPS and latency numbers for each iteration.
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2019-09-18 19:50:43 +00:00
Petros Koutoupis
36d13d3b97
Enable global default dir layout for subdirs in Lustre
2019-09-02 22:26:12 -07:00
Glenn K. Lockwood
b025d6bdb3
Merge pull request #153 from glennklockwood/docfixes
...
Updated documentation
2019-07-30 19:29:37 -05:00
Wei-keng Liao
3eb0f86640
Function ncmpi_get_file_info was first introduced in
...
PnetCDF version 1.2.0. Check PnetCDF library version,
so printing MPI-IO hints can be enabled for NCMPI.
2019-06-28 17:40:35 -05:00
Julian M. Kunkel
cf197d5e38
Moved broken collectiveMetadata option into HDF5 backend module. #154
2019-05-22 10:21:18 +01:00
Glenn K. Lockwood
23106d17db
forgot to RST-ify this
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
0bb96e9684
added docs for release process
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
2241f77a5d
got NEWS importing correctly
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
aa3f045c92
fix spelling mistake
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
57f47db37f
odds and ends
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
d0237d6d66
skript -> script
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
2333c23bed
clean up intro
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
11d63f067a
updated formatting
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
32f256f4ef
bugfix
2019-05-19 09:40:43 -07:00
Glenn K. Lockwood
13fd0c6c16
populate sphinx doc versions automatically
2019-05-19 09:40:43 -07:00
Vaclav Hapla
13a17352ec
Update tutorial.rst
...
"Defeating Page Cache" should be a heading I guess.
2019-05-16 20:48:28 +02:00
Julian Kunkel
acee84bedc
Merge pull request #88 from roblatham00/hdf5-coll-md
...
HDF5: option to enable collective metadata
2018-10-02 16:13:05 +01:00
Julian M. Kunkel
1f1e56c363
Usleep feature added according to Nathan's suggestions.
2018-09-30 10:01:21 +01:00
Rob Latham
7d2464f733
HDF5: option to enable collective metadata
...
In HDF5-1.10 the library has an option to read and write the metadata of a file collectively. One has to opt-in to this optimization with a property list but particularly at large scale it can have tremendous performance implications.
Further information:
- https://support.hdfgroup.org/HDF5/docNewFeatures/CollMDataIO/RFC-CollectiveMetadataReads.pdf
- https://support.hdfgroup.org/HDF5/doc/RM/RM_H5P.html#Property-SetAllCollMetadataOps
2018-09-20 11:12:08 -05:00
Julian M. Kunkel
be0b840ddd
First attempt to describe new backend options.
2018-08-15 17:13:59 +01:00
Shane Snyder
0ca5f26e84
cleanup RADOS func names and docs
2018-08-14 16:18:35 -05:00
Jean-Yves VET
44ce8e5aaf
Add backend for DDN's Infinite Memory Engine (IME)
...
This patch adds the support of IME Native interface
as a new AIORI backend.
2018-08-07 11:41:07 +01:00
Julian M. Kunkel
0f7a1f14b9
Support IO redirect from main()
2018-07-08 13:12:18 +01:00
Enno Zickler
6267203147
Doc: add tutorial, user guide and CI
...
This adds a beginners tutorial and splits up the conten of the old user
guide in categories. In the developer section gets a page for the
travis-CI.
2018-03-15 21:52:34 +01:00
Enno Zickler
d5507955af
Doc: Initial setup for Sphinx and Doxygen
2018-03-15 21:52:10 +01:00
Nathan Hjelm
4dc0081628
First cut at using the IOR backends for mdtest
...
This commit makes changes to the AIORI backends to add support for
abstacting statfs, mkdir, rmdir, stat, and access. These new
abstractions are used by a modified mdtest. Some changes:
- Require C99. Its 2017 and most compilers now support C11. The
benefits of using C99 include subobject naming (for aiori backend
structs), and fixed size integers (uint64_t). There is no reason to
use the non-standard long long type.
- Moved some of the aiori code into aiori.c so it can be used by both
mdtest and ior.
- Code cleanup of mdtest. This is mostly due to the usage of the IOR
backends rather than a mess of #if code.
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2017-10-19 15:29:12 -06:00
Oliver Steffen
738190bd79
add support for tuning BeeGFS parameters
2017-10-04 14:14:36 +02:00
Brett M. Kettering
18d6ed753a
Added documenation for HDFS, S3, and S3_EMC APIs.
2015-09-04 12:46:35 -06:00
blair-crossman
fc1101e450
Added in the validation I did for incompressible. Edited the USER_GUIDE
...
with a section about the pitfalls of the incompressible flag.
2015-05-29 10:48:54 -06:00
Blair Crossman
08d14e986d
Added an uncompressible data packet to IOR.
...
Changed how the -l option works. Now you choose the type of datapacket
-l i incompressible data packets
-l incompressible incompressible data packets
-l timestamp timestamped data packets
-l t timestamped data packets
-l offset offset data packets
-l o offset data packets
-G option now is either the seed for the incompressible random packets
or the timestamp, depending on the input to the -l option.
-G will no long timestamp packets on its own without the additon of -l timestamp or -l t
I kept shorter versions of the options for the sake of typing sanity.
2015-05-21 12:05:56 -06:00
Jeff Inman
37738dab26
Numerous changes to file-modes, small build-tweaks, and a tweak to aiori-S3.c
...
(Only rank-0 should create the bucket, if it doesn't already exist.)
Prepping this for a push (as an experimental S3 build) to github.
2015-05-19 09:36:28 -06:00
Rob Latham
aa604c1d38
Teach IOR about GPFS hints (gpfs_fcntl)
...
GPFS supports a "gpfs_fcntl" method for hinting various things,
including "i'm about to write this block of data". Let's see if, for
the cost of a few system calls, we can wrangle the GPFS locking system
into allowing concurrent access with less overhead. (new IOR parameter
gpfsHintAccess)
Also, drop all locks on a file immediately after open/creation in the
shared file case, since we know all processes will touch unique regions
of the file. It may or may not be a good idea to release all file locks
after opening. Processes will then have to re-acquire locks already
held. (new IOR parameter gpfsReleaseToken)
2013-10-03 18:07:49 -07:00
Christopher J. Morrone
6251589601
Add memoryPerNode documentation
2012-01-13 15:47:59 -08:00
Christopher J. Morrone
9ac80230a4
Documentation update
2012-01-13 15:45:04 -08:00
Christopher J. Morrone
5f162061bd
Change testNum to refNum
2012-01-13 15:45:02 -08:00
Christopher J. Morrone
ef70266a84
Allow long summary to be printed for every test.
2012-01-13 15:43:54 -08:00
Christopher J. Morrone
8c95611125
Alphabetize the command line options
2012-01-13 15:43:47 -08:00
Christopher J. Morrone
253941fc6c
Fix "make dist"
2012-01-08 20:31:01 -08:00
Christopher J. Morrone
06f65eae23
Update documentation
2012-01-08 19:43:41 -08:00
Christopher J. Morrone
349f747ea5
Remove undocumented options.
2012-01-08 19:43:41 -08:00
Christopher J. Morrone
4084e14d02
Add memoryPerNode option
2012-01-08 19:36:43 -08:00
Christopher J. Morrone
4ae5742f87
Replace defaults.h with a simple initializer function.
2011-11-09 16:30:01 -08:00
Christopher J. Morrone
ea7f987d80
Include the docs as "DATA"
2011-10-27 19:07:59 -07:00
Christopher J. Morrone
02fda88fd0
Begin conversion to autoconf
2011-10-27 17:45:09 -07:00