2b5319b37c
IOR: fix overflow in offset calculations
...
In expression 'i * test->numTasks', both operands have int type.
It will overflow 32 bits when the 'segmentCount' and 'numTasks' are large enough.
2021-05-30 18:56:58 +08:00
0410a38e98
IOR: add several sanity checks for stonewalling #345
2021-04-13 11:01:30 +02:00
a490ac8ba6
Bugfix IOR writecheck #354
2021-03-29 20:11:10 +02:00
a436395570
Support random data generation for memory pattern in utilities. ( #348 )
...
* Support random data generation in utilities. Update first 8 byte element in each 4k block on updates to defy dedup.
* Incorporate different packet types into mdtest/md-workbench.
* Integrated utilities memory pattern tools into IOR. Now all tools use the same patterns.
* Added IOR long option for compatibility between IOR and other tools.
* Added new tests for random buffers.
2021-03-18 21:42:50 +01:00
3be3cfb274
Fix MPI-IO strided access. ( #347 )
...
* Remove MPI-IO malloc.
* Bugfix for MPI-IO segmented/view.
2021-03-17 00:24:23 +01:00
4bad282932
Make noncontiguous I/O work again ( #341 )
2021-03-06 09:53:39 +00:00
74df77430f
Feature ior gpu #284 ( #323 )
...
* Basic support for memory allocation on GPU using CUDA unified memory. Partially addressing #284 . IOR support completed.
* Support for GPU alloc in MDTest and MD-Workbench
* Option: support repeated parsing of same option (allows option sharing across modules).
* Checks for gpuDirect
* Integrate gpuDirect options and basic hooks, more testing to be done.
* POSIX: basic gpuDirect implementation working with fake-gpudirect library.
* CUDA allow setting of DeviceID for IOR (not yet MDTest).
* CUDA/GPUDirect Support --with-X=<path>
* Bugfix in option parser for flags that are part of an argument for an option, e.g., -O=1, if 1 is a flag it is wrongly assumed to be a flag.
2021-02-18 10:40:42 +00:00
b5963380ae
Feature: IOR rank details in CSV file ( #334 )
...
* IOR: Store individual rank results into a CSV file #333
Example usage: ior -O saveRankPerformanceDetailsCSV=test.csv
2021-02-09 17:54:14 +00:00
fa5b24f2aa
Bugfix user docu for ranks. Bugfix missmatching barriers.
2021-02-08 13:28:13 +00:00
7b69fc1500
Free testcom after finalize.
2021-01-29 14:00:17 +00:00
351fd4dfb9
Move initialization of TestComm before aiori->initialize()
2021-01-29 09:08:54 +00:00
4edb27b41a
Remove MPI timer in favor of gettimeofday() to prevent MPI issues. Remove time adjustment as measurements are relative anyway.
2021-01-20 19:38:54 +00:00
d5f5cf974d
Merge pull request #318 from hpc/fix-comm
...
Refactoring: remove global comm_world communicator from utilities.c
2021-01-20 18:25:53 +00:00
9e0a8c44d5
IOR: move verbose output of detailed errors to verbosity level 1. ( #315 )
...
IOR by default outputs the numbers of errors.
Reason: The amount of error messages can be overwhelming, particularly in a parallel program (Gigabytes...).
One -v increases the verbosity level to provide the extra details without adding too many other messages.
2021-01-20 15:06:45 +00:00
f345a78046
Removed dependency.
2021-01-20 15:00:33 +00:00
970c5ef139
Adjust complex tests for changed -z behavior.
2021-01-20 14:57:21 +00:00
40c6d97e72
Replaced MPI_COMM_WORLD where needed with testComm.
2021-01-20 14:35:06 +00:00
e4120d600d
Reduce the dependency to global MPI Communicator
2021-01-20 14:06:05 +00:00
58fbefbd33
Bugfix IOR offsetting (fix before was incomplete). ( #317 )
2021-01-19 23:19:01 +00:00
19ad73568a
Bugfix ior stonewalling case. ( #316 )
...
* Bugfix ior stonewalling case.
2021-01-19 22:28:34 +00:00
8de13884a7
HDFS module ported to current AIORI API and improved ( #302 )
...
* HDFS module ported to current AIORI API and extended
* Added instructions how to build and run with a HDFS.
* Replaced read with pread to support offsets.
* Implemented HDFS MDTest API
* Improved sync semantics
2020-12-23 11:51:31 +00:00
69e006dd89
IOR clarify return API.
2020-12-03 21:07:45 +00:00
073da08292
IOR: print overwrite check only if a write operation is requested.
2020-12-03 20:54:51 +00:00
a8ab766483
Merge pull request #270 from hpc/fix-offset-integration
...
Fix offset integration
2020-12-03 12:08:53 +00:00
f71a144b19
IOR raise warning for existing file once if not filePerProc.
2020-12-02 10:14:28 +00:00
da03ae5c9f
IOR add warning if file exists #273 . To stop on warnings, use existing flag --warningAsErrors
2020-12-01 18:24:09 +00:00
9dcf9f79e4
Moved barriers to right location.
2020-12-01 14:47:57 +00:00
546eb05d15
Rudimentary support for stonewall added, addresses #261 .
2020-12-01 14:45:07 +00:00
5825dbae35
Provide new option randomPrefill for random (-z access only) that prefill the file with the specified blocksize, e.g., 2m. See issue #270 .
...
This option works so far only without stonewalling!
2020-12-01 13:58:40 +00:00
a59e98d7a6
Add error to indicate changed behavior to users
2020-11-06 10:39:16 +00:00
af0753d8ad
Random: last modifications.
2020-11-06 10:27:11 +00:00
a0e5e297d6
Create random for one block (1 segment) only to be repeated.
2020-11-06 09:52:35 +00:00
3ee3e9ad5c
Integrated sequential code into the benchmark main loop.
...
A bit ugly but shows that the code logic hasn't changed.
2020-11-05 14:00:09 +00:00
fb66e77072
Enable random seed to be stored. ( #268 )
2020-11-04 13:47:35 +00:00
cb397242f9
DAOS backend cleanup ( #266 )
...
- remove legacy DAOS driver & update Readme.
- update configure options to remove cart requirement
- Optimize DFS file get_size
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-11-03 10:01:09 +00:00
dab62b57c8
fix JSON format, the end of Array object ( #264 )
2020-10-28 09:38:17 +00:00
bd76b45ef9
Integrated comparison checks into CompareData() which prevents additi… ( #254 )
...
* Integrated comparison checks into CompareData() which prevents additional buffer comparisons at the expense of some computation #249 .
* IOR: Added code documentation to warn people for changing the creation pattern but not the verification pattern.
2020-09-28 20:09:48 +01:00
af2429b47e
Fix s3-4c implementation ( #247 )
...
* Ported S3-4c version to current AIORI interface.
* S3-4c: add crypto dependency
* S3: Store username/host in options.
2020-08-13 16:25:36 +01:00
4e2d179052
Detection of system features for number of sockets #245 ( #246 )
...
* Configure checks for architecture-specific functions to detect nr of sockets. #245
2020-08-03 12:30:21 +01:00
8ca388fc78
Merge branch 'feature-cleanup-aiori'
2020-07-21 09:26:03 +01:00
f280123d0b
Spelling fixes (found by codespell)
2020-07-03 09:16:30 +02:00
87c9906d70
Error checking for NULL create/opens
2020-06-30 19:41:49 +01:00
82417128cd
Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI.
2020-06-30 12:33:56 +01:00
3395fc621c
Moved GetFileSize into CheckFileSize, starting to simplify get_file_size (too much replication in modules).
2020-06-30 12:03:05 +01:00
38b1752bda
JSON issue with results. Fix for #233 .
2020-06-25 14:37:52 +01:00
0bffd14de7
Added --warningAsErrors option to IOR and MDTest and refactored WARNINGs in IOR. #174
2020-06-24 11:13:12 +01:00
d5de9bcc77
Merge branch 'master' into master
2020-06-24 09:50:03 +01:00
6a88b37171
Merge branch 'master' into fix-194
2020-06-24 09:43:37 +01:00
b4a54c34e8
Merge branch 'master' into fix-modules
...
Conflicts:
src/aiori-DAOS.c
src/aiori-DFS.c
2020-06-11 19:55:23 +00:00
eb2cd27fac
Removed offset from IOR structure.
2020-06-10 17:47:07 +01:00
Runji Wang