mdtest/src
Jeffrey Thornton Inman 2f066624f0 S3 with Multi-Part Upload for N:1 is working.
Testing on our EMC ViPR installation.  Therefore, we also have available
some EMC extensions.  For example, EMC supports a special "byte-range"
header-option ("Range: bytes=-1-") which allows appending to an object.
This is not needed for N:1 (where every write creates an independent part),
but is vital for N:N (where every write is considered an append, unless
"transfer-size" is the same as "block-size").

We also use a LANL-extended implementation of aws4c 0.5, which provides
some special features, and allows greater efficiency.  That is included in
this commit as a tarball.  Untar it somewhere else and build it, to produce
a library, which is linked with IOR.  (configure with --with-S3).

TBD: EMC also supports a simpler alternative to Multi-Part Upload, which
appears to have several advantages.  We'll add that in next, but wanted to
capture this as is, before I break it.
2014-10-27 13:29:44 -06:00
..
win Add header to set code preferences for vi and emacs. 2012-01-08 19:43:41 -08:00
Makefile.am S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
aiori-HDF5.c Define H5_USER_16_API to enable HDF5 backwards compatibility 2013-07-18 15:01:15 -07:00
aiori-HDFS.c Fixed bug in aiori-HDFS.c where it was calling "free(fd);", which is bad. 2014-08-28 15:39:44 -06:00
aiori-MPIIO.c Initial commit of the new aiori-HDFS module. 2014-08-13 17:02:43 -06:00
aiori-NCMPI.c Add header to set code preferences for vi and emacs. 2012-01-08 19:43:41 -08:00
aiori-PLFS.c First-cut at PLFS support, integrating Brett K's code. 2014-09-18 11:20:37 -06:00
aiori-POSIX.c First-cut at PLFS support, integrating Brett K's code. 2014-09-18 11:20:37 -06:00
aiori-S3.c S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
aiori.h S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
ior.c S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
ior.h S3 with Multi-Part Upload for N:1 is working. 2014-10-27 13:29:44 -06:00
iordef.h Initial commit of the new aiori-HDFS module. 2014-08-13 17:02:43 -06:00
parse_options.c Don't have IOR_RDWR in open-flags, if only opening for reading or writing. 2014-08-25 15:51:28 -06:00
parse_options.h Add header to set code preferences for vi and emacs. 2012-01-08 19:43:41 -08:00
utilities.c First-cut at PLFS support, integrating Brett K's code. 2014-09-18 11:20:37 -06:00
utilities.h First-cut at PLFS support, integrating Brett K's code. 2014-09-18 11:20:37 -06:00