Julian Kunkel
dcacb341e4
Merge pull request #330 from hpc/fix-329
...
Bugfix user docu for ranks #329 . Bugfix missmatching barriers.
2021-02-08 13:54:06 +00:00
Julian M. Kunkel
fa5b24f2aa
Bugfix user docu for ranks. Bugfix missmatching barriers.
2021-02-08 13:28:13 +00:00
Julian Kunkel
f15956247f
Merge pull request #327 from hpc/fix-testing
...
Testing improvements.
2021-02-05 11:36:11 +00:00
Julian M. Kunkel
bdde24bd91
Save testlogs into directory per type.
2021-02-05 11:24:53 +00:00
Julian M. Kunkel
b4db470459
Testing improvements.
...
Uploaded new mdtest patterns. Make them invariant to line nrs.
Added md-workbench tests.
Added --oversubscribe option if MPI understands it (needed for some systems)
2021-02-05 11:17:15 +00:00
Julian Kunkel
e5e1053405
Merge pull request #326 from hpc/fix-mdworkbench-check
...
MDWorkbench: Fix new verification option
2021-02-05 11:14:26 +00:00
Julian M. Kunkel
265cdb2a42
MDWorkbench: Fix new verification option
2021-02-05 10:49:35 +00:00
Julian Kunkel
3f465c61ff
Merge pull request #325 from hpc/fix-init
...
Move initialization of TestComm before aiori->initialize()
2021-01-29 14:19:57 +00:00
Julian M. Kunkel
7b69fc1500
Free testcom after finalize.
2021-01-29 14:00:17 +00:00
Julian M. Kunkel
351fd4dfb9
Move initialization of TestComm before aiori->initialize()
2021-01-29 09:08:54 +00:00
Julian Kunkel
4c6f33f0f9
Merge pull request #322 from hpc/feature-mdtest-randnum
...
MDTest data verification improvements.
2021-01-22 15:38:44 +00:00
Julian M. Kunkel
0a066d8285
MD-Worbench: add -G option to set parameter.
2021-01-22 14:38:36 +00:00
Julian M. Kunkel
7061b60ed8
Extracted memory pattern comparison, added mem check option to md-workbench.
2021-01-22 14:05:58 +00:00
Julian M. Kunkel
effcb4131c
MDTest: add randomness to buffers to defend dedup efforts. Allow to set random offset externally.
2021-01-22 12:24:33 +00:00
Julian M. Kunkel
3af915aae1
MDTest data verification. Fixed bug: added missing reduce. Add rank into I/O buffer to make individual files unique.
2021-01-22 12:10:09 +00:00
Julian Kunkel
310fd37427
Feature mdtest dir rename #306 ( #311 )
...
* MDTest: Support for directory renaming.
* Refactored some MDTest variables from hardcoded numbers to ENUM symbols.
2021-01-21 14:10:23 +00:00
Julian Kunkel
4ba0eda38f
Merge pull request #321 from hpc/fix-posix-warn
...
AIORI POSIX use internal debug macros, include errno in msg.
2021-01-21 11:38:55 +00:00
Julian Kunkel
6e741054ac
Merge pull request #320 from hpc/fix-timer
...
Remove MPI timer in favor of gettimeofday() to prevent MPI timing issues.
2021-01-21 11:38:29 +00:00
Julian Kunkel
a2afcf7740
Merge pull request #319 from hpc/fix-309
...
MDTest replace fatals with warnings making the API more robust while …
2021-01-21 11:23:43 +00:00
Julian M. Kunkel
852ee3e40e
AIORI POSIX use internal debug macros, include errno in msg.
2021-01-21 11:06:13 +00:00
Julian M. Kunkel
4edb27b41a
Remove MPI timer in favor of gettimeofday() to prevent MPI issues. Remove time adjustment as measurements are relative anyway.
2021-01-20 19:38:54 +00:00
Julian Kunkel
d5f5cf974d
Merge pull request #318 from hpc/fix-comm
...
Refactoring: remove global comm_world communicator from utilities.c
2021-01-20 18:25:53 +00:00
Julian M. Kunkel
eb111f4279
MDTest replace fatals with warnings making the API more robust while it resolves #309 .
...
Example execution (can be done multiple times without cleanup):
$ mpiexec -np 2 ./src/mdtest -d test@test -u -n 100 -C
2021-01-20 15:19:38 +00:00
Julian Kunkel
9e0a8c44d5
IOR: move verbose output of detailed errors to verbosity level 1. ( #315 )
...
IOR by default outputs the numbers of errors.
Reason: The amount of error messages can be overwhelming, particularly in a parallel program (Gigabytes...).
One -v increases the verbosity level to provide the extra details without adding too many other messages.
2021-01-20 15:06:45 +00:00
Julian M. Kunkel
f345a78046
Removed dependency.
2021-01-20 15:00:33 +00:00
Julian M. Kunkel
970c5ef139
Adjust complex tests for changed -z behavior.
2021-01-20 14:57:21 +00:00
Julian M. Kunkel
40c6d97e72
Replaced MPI_COMM_WORLD where needed with testComm.
2021-01-20 14:35:06 +00:00
Julian M. Kunkel
e4120d600d
Reduce the dependency to global MPI Communicator
2021-01-20 14:06:05 +00:00
Julian Kunkel
58fbefbd33
Bugfix IOR offsetting (fix before was incomplete). ( #317 )
2021-01-19 23:19:01 +00:00
Julian Kunkel
19ad73568a
Bugfix ior stonewalling case. ( #316 )
...
* Bugfix ior stonewalling case.
2021-01-19 22:28:34 +00:00
Julian Kunkel
3daf7a2d0f
Bugfix: valgrind memory issues ( #314 )
2021-01-19 21:23:30 +00:00
Mohamad Chaarawi
fa316d5d24
dfs: conditionally compile out svcl setting ( #313 )
...
The SVCL argument is being removed from the DAOS API, so conditionally
compile out while maintaining backwards compatibility to versions where
it's still required.
2021-01-19 13:43:01 +00:00
Julian Kunkel
b2089514e3
MDTest calculate min/max/mean across iterations #300 . ( #312 )
...
The calculation per iteration first computes the value of the slowest process, i.e., highest time or lowest rate. This is then the value for the iteration.
Secondly, calculate the min/max/mean across iterations.
For tree operations, the value is identical to previous as only Rank 0 is involved.
2021-01-18 21:30:16 +00:00
Julian Kunkel
33b70ecbc8
Fix MDTest multidir option to work with stonewall file. ( #308 )
2021-01-14 17:38:11 +00:00
Julian Kunkel
4a96436928
MDTest convert FATAL to WARN ( #307 )
2021-01-14 16:41:56 +00:00
Julian Kunkel
d339caa501
Updated test (illustration of an empty test) and distclean for make distcheck #304 ( #305 )
...
Resolves #304
2021-01-04 10:50:38 -08:00
Julian M. Kunkel
21bf5a5a12
NCMPI ported to current ADIO. Fixed autoconf #303 .
2020-12-25 16:49:04 +00:00
Glenn K. Lockwood
eb883f533a
update release docs based on 3.3.0 release experience
2020-12-23 18:17:47 -08:00
Glenn K. Lockwood
e579531970
update NEWS for 3.3 release
2020-12-23 17:06:56 -08:00
Glenn K. Lockwood
f467903cb9
draft of a new simplified release process ( #297 )
2020-12-23 11:56:49 +00:00
Julian Kunkel
8de13884a7
HDFS module ported to current AIORI API and improved ( #302 )
...
* HDFS module ported to current AIORI API and extended
* Added instructions how to build and run with a HDFS.
* Replaced read with pread to support offsets.
* Implemented HDFS MDTest API
* Improved sync semantics
2020-12-23 11:51:31 +00:00
Julian Kunkel
3e4a0f69d9
Merge pull request #296 from mchaarawi/mschaara/fix_dfs_stat_rc
...
aiori-DFS: stat should not be fatal
2020-12-16 15:53:43 +00:00
Mohamad Chaarawi
6675cd50bf
aiori-DFS: stat should not be fatal
...
ior now expects stat to not be fatal. update the DFS driver to not
exit if stat fails since the file can simply not exist.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-12-16 15:41:58 +00:00
Frank
0bd52884e8
added region and location to libs3 ( #295 )
...
* added region and location to libs3
2020-12-11 13:05:24 +00:00
Julian Kunkel
fbee4139d8
Merge pull request #292 from ofaaland/b-fix-mpi-checkf
...
Do not execute functions twice in MPI_CHECKF
2020-12-04 09:20:21 +00:00
Julian Kunkel
21237e019a
Merge pull request #294 from hpc/fix-calc-stonewall
...
Fix calc stonewall
2020-12-03 21:11:41 +00:00
Julian M. Kunkel
69e006dd89
IOR clarify return API.
2020-12-03 21:07:45 +00:00
Julian M. Kunkel
073da08292
IOR: print overwrite check only if a write operation is requested.
2020-12-03 20:54:51 +00:00
Olaf Faaland
231868505d
Do not execute functions twice in MPI_CHECKF
...
Assigning MPI_STATUS to a local variable and then referring to the
local will ensure that the same value is used in both the conditional
expression and the call to MPI_Error_string.
Otherwise, when MPI_STATUS is a function call, like
MPI_CHECKF(fubar(), "%s", "error in fubar");
fubar() is called twice. If there are underlying intermittent errors,
the error code/message for the first call is lost, with confusing output
like this:
read 2206.18 17.27 145.93 262144 131072
0.272595 291.88 0.290829 292.41
ERROR: cannot access explicit, noncollective, MPI MPI_SUCCESS: no errors, (aiori-MPIIO.c:451)
2020-12-03 12:21:06 -08:00
Julian Kunkel
a8ab766483
Merge pull request #270 from hpc/fix-offset-integration
...
Fix offset integration
2020-12-03 12:08:53 +00:00