mdtest with fsync
 
 
 
 
Go to file
Jeffrey Thornton Inman 2f066624f0 S3 with Multi-Part Upload for N:1 is working.
Testing on our EMC ViPR installation.  Therefore, we also have available
some EMC extensions.  For example, EMC supports a special "byte-range"
header-option ("Range: bytes=-1-") which allows appending to an object.
This is not needed for N:1 (where every write creates an independent part),
but is vital for N:N (where every write is considered an append, unless
"transfer-size" is the same as "block-size").

We also use a LANL-extended implementation of aws4c 0.5, which provides
some special features, and allows greater efficiency.  That is included in
this commit as a tarball.  Untar it somewhere else and build it, to produce
a library, which is linked with IOR.  (configure with --with-S3).

TBD: EMC also supports a simpler alternative to Multi-Part Upload, which
appears to have several advantages.  We'll add that in next, but wanted to
capture this as is, before I break it.
2014-10-27 13:29:44 -06:00
config Make IOR get its version from a META file. 2011-10-27 18:46:30 -07:00
contrib Remove CVS references 2012-01-08 19:43:41 -08:00
doc Teach IOR about GPFS hints (gpfs_fcntl) 2013-10-03 18:07:49 -07:00
scripts Start with the code from IOR-2.10.3 2011-06-17 12:20:43 -07:00
src S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
testing Remove CVS references 2012-01-08 19:43:41 -08:00
.gitignore Fixed bug in aiori-HDFS.c where it was calling "free(fd);", which is bad. 2014-08-28 15:39:44 -06:00
COPYRIGHT Start with the code from IOR-2.10.3 2011-06-17 12:20:43 -07:00
ChangeLog Rename RELEASE_LOG to ChangeLog and update 2012-01-08 19:43:33 -08:00
META Prep for tagging 3.0.1 2012-11-21 10:15:06 -08:00
Makefile.am Fix "make dist" 2012-01-08 20:31:01 -08:00
README Update documentation 2012-01-08 19:43:41 -08:00
bootstrap Begin conversion to autoconf 2011-10-27 17:45:09 -07:00
configure.ac S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
lanl_aws4c.tgz S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00

README

Building
--------

0. If "configure" is missing from the top level directory, you
   probably retrieved this code directly from the repository.
   Run "./bootstrap".

   If your versions of the autotools are not new enough to run
   this script, download and official tarball in which the
   configure script is already provided.

1. Run "./configure"

   See "./configure --help" for configuration options.

2. Run "make"

3. Optionally, run "make install".  The installation prefix
   can be changed as an option to the "configure" script.