Julian M. Kunkel
0f7a1f14b9
Support IO redirect from main()
2018-07-08 13:12:18 +01:00
Shane Snyder
0052bff3e9
use backend->access in IOR source
...
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 12:13:38 +01:00
Shane Snyder
8069e018e3
make ncmpi/hdf5 use mpiio access/delete
...
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 12:13:38 +01:00
Julian M. Kunkel
1a3c92718b
Fix merge
2018-07-08 12:13:08 +01:00
Shane Snyder
7d3c7e901e
expose generic aiori_ calls for access, etc.
...
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 12:09:44 +01:00
Enno Zickler
9e97a16fe4
fix output to be allinge with column headers
...
Signed-off-by: Julian M. Kunkel <juliankunkel@googlemail.com>
2018-07-08 11:54:49 +01:00
Julian M. Kunkel
d938f0efe1
MPIIO support fsync.
2018-07-08 00:16:30 +01:00
Julian M. Kunkel
fd4c306b98
MDTest stonewalling with status file.
...
Appears to work; stonewall timer is honored only in the creation phase.
This implies a limit to the objects that then are used for other phases.
2018-07-07 23:56:39 +01:00
Julian M. Kunkel
58f13ba352
Bugfix: extraction to count ranks per host used local communicator.
2018-07-07 22:54:40 +01:00
Julian M. Kunkel
31e3cc2b60
Bugfix extraction further.
2018-07-07 22:46:13 +01:00
Julian M. Kunkel
b27b50184a
Bugfix Refactoring MaxLen
2018-07-07 22:42:05 +01:00
Julian M. Kunkel
ed5787811c
Extracted max pathlen variable.
2018-07-07 22:39:14 +01:00
Julian M. Kunkel
48c17b4d81
Extracted (nearly identical) function DelaySeconds.
2018-07-07 22:26:57 +01:00
Julian M. Kunkel
6f8d2e8845
Some simplification / unification between IOR and MDTest.
...
MDTest needs more refactoring to be really maintainable.
2018-07-07 22:19:42 +01:00
Julian M. Kunkel
7bc868d5cf
Dummy AIORI supporting MDtest ops.
2018-07-07 20:01:03 +01:00
Julian M. Kunkel
b4f356a7b2
Bugfix: StoneWallingStatusFile.
2018-07-07 14:14:55 +01:00
Julian M. Kunkel
812b798f05
IOR allows to store actual performaned stonewalling count into a status file.
2018-07-07 14:01:11 +01:00
Julian M. Kunkel
378789737f
Dummy AIORI driver
2018-07-07 13:25:17 +01:00
Julian M. Kunkel
15c383b0d1
Extended description for #44
2018-07-07 12:20:29 +01:00
Julian M. Kunkel
e10bebe653
MDTest supports only POSIX at the moment. Added command line check.
2018-07-07 12:14:34 +01:00
Julian M. Kunkel
e31b2dcec1
Added missing file.
2018-07-07 11:57:04 +01:00
Julian M. Kunkel
21b8cca8cf
IOR library version.
2018-07-07 11:42:21 +01:00
Julian M. Kunkel
a6bfa0f94b
MDTest library option.
...
Moved core functionality / variables used by both implementations to utilities
2018-07-07 10:42:48 +01:00
Julian M. Kunkel
bcaea2a39f
Replaced getopt with an alternative version (on some machines optind was broken).
2018-07-07 08:41:33 +01:00
Adam Moody
156a514c8b
open file in RDWR when using write + checkWrite
2018-05-16 16:52:20 -07:00
Adam Moody
43cc47b7f0
use MPI_COMM_SELF when opening file to get file size in MPIIO
2018-05-16 12:31:23 -07:00
Li Dongyang
6ba22a19e4
Add mmap as a new AIORI backend
...
It shares the create/open/delete/set_version/get_file_size
functions with POSIX backend.
The mmap backend also supports fsync and fsyncPerWrite options,
and it will use msync() instead and fsync().
Signed-off-by: Li Dongyang <dongyangli@ddn.com>
2018-05-11 12:13:42 +10:00
Glenn K. Lockwood
7a371cfeda
Merge pull request #46 from lidongyang/iops
...
Add OPs result columns back
2018-04-23 13:12:43 -07:00
Glenn K. Lockwood
a80cc44fb1
fixes #47
2018-04-23 13:10:04 -07:00
Li Dongyang
0d2c9e5451
Add OPs result columns back
...
Signed-off-by: Li Dongyang <dongyangli@ddn.com>
2018-04-18 14:24:42 +10:00
Enno Zickler
16c8ef6a23
Doc: src comments for getOffsetArray functions
2018-03-15 21:52:34 +01:00
Enno Zickler
d5507955af
Doc: Initial setup for Sphinx and Doxygen
2018-03-15 21:52:10 +01:00
Jean-Yves VET
6d3edaffc8
Implement an access function for MPIIO backend
...
Context: Some file systems require a prefix in the path.
The POSIX 'access' call fails and consequently files are
never deleted.
This patch implements an access function in the MPIIO
backend using MPI_File_open. Prefixes can now be parsed
by ROMIO.
2018-03-01 11:34:49 +01:00
Glenn K. Lockwood
9a200097a5
Merge pull request #31 from ezickler/O_DIRECTfix
...
Fix O_DIRECT option
2018-01-25 09:32:00 -08:00
Enno Zickler
87fe8485a7
Fix O_DIRECT option
...
The O_DIRECT option was not working as set_o_direct_flag() were moved to
utilities.c but there the #define _GNU_SOURCE where missing. This lead
to not the Waring "cannot use O_DIRECT".
2018-01-25 10:51:35 +01:00
Alexander Hück
3ef16c3030
initialize path variable correctly
2018-01-24 19:26:53 +01:00
Glenn K. Lockwood
e6e0527d72
Merge pull request #17 from lwh1990/master
...
Fix compatibility issues with pnetcdf > 1.7 (prior versions continue to work as well)
2017-12-12 10:58:14 -08:00
Glenn K. Lockwood
3887668bda
Merge pull request #19 from VI4IO/master
...
Various bug fixes and code cleanup
2017-12-12 10:56:09 -08:00
Julian M. Kunkel
cdc93da3a4
Check for command line slight naming change.
2017-12-09 17:24:31 +01:00
Julian M. Kunkel
93355314de
Adjusted command line checks for recent changes in semantics for readCheck/writeCheck.
2017-12-09 17:22:58 +01:00
Julian M. Kunkel
1f6d062f7f
Bugfix #22
2017-12-09 11:52:13 +01:00
Glenn K. Lockwood
10e2b2efa2
make all references to API name case-insensitive (fix for 6ba323b
)
2017-12-04 15:20:31 -08:00
Julian M. Kunkel
c9d6c2316e
Bugfix for self referencing sprintf #20
...
Backmerge from IOR fork.
2017-11-30 12:01:19 +01:00
Julian M. Kunkel
2c224e0ee8
Bugfix for #14 , storeFileOffset=1
2017-11-30 11:56:26 +01:00
Julian Kunkel
b67c5ce62c
Bugfix for #14
...
WriteCheck did not work properly due to shifting of patterns.
It is possible that one buffer could be saved by refactoring the code properly.
2017-11-29 10:17:02 +01:00
Julian Kunkel
6436165edb
For debugging of issues: added IOR_FAKE_TASK_PER_NODES env variable to set tasksPerNode.
2017-11-29 09:54:22 +01:00
VinsonLeung
d1f9e9aee3
change Pnetcdf IO funtion
...
change Pnetcdf IO function which can avoid incompatible MPI datatype problem
2017-11-22 23:20:22 -06:00
VinsonLeung
f8e6cd033a
change MPI_BYTE to MPI_SIGNED_CHAR
...
From Pnetcdf 1.7, the MPI datatype corresponding to NC_BYTE is change from MPI_BYTE to MPI_SIGNED_CHAR. If not change, running IOR with NCMPI will cause a fatal error as below:
ERROR in aiori-NCMPI.c (line 287): cannot write to data set.
ERROR: NetCDF: Not a valid data type or _FillValue type mismatch.
2017-11-20 13:56:36 -06:00
VinsonLeung
fd0e99e544
fix a bug when compile with ncmpi enabled
...
The file "src/aiori-NCMPI.c" uses numTasksWorld as the process which is declared in "src/ior.h". In "src/mdtest.c", NCMPI backend will be called if IOR configured with ncmpi enabled but numTasksWorld was not defined in "src/mdtest.c". So it will cause a compiler error like below:
mdtest-aiori-NCMPI.o: In function `NCMPI_Xfer':
/home/parallels/Documents/ior/src/aiori-NCMPI.c:272: undefined reference to `numTasksWorld'
2017-11-19 16:38:12 -06:00
Glenn K. Lockwood
3aa1f4c9b7
Merge pull request #11 from VI4IO/master
...
StoneWalling with WearOutPhase
2017-11-15 00:09:22 -07:00