Commit Graph

687 Commits (76d5a77ac2bc6fc9477e746a5bd2eaebcd2f6bed)

Author SHA1 Message Date
Andreas Dilger 76d5a77ac2 Add missing options to mdtest man page 2020-11-25 01:28:07 -07:00
Julian Kunkel b12742e1ad
Merge pull request #275 from hpc/fix-libs3
Bugfix S3: suboptimal name mapping was leading to accidential deletes in md-workbench.
2020-11-22 12:05:51 +00:00
Julian M. Kunkel 02a47085ec Bugfix: suboptimal name mapping was leading to accidential deletes in md-workbench. 2020-11-22 12:01:12 +00:00
Julian Kunkel c7f2870004
Merge pull request #274 from hpc/fix-libs3
Move option checks before inititalization.
2020-11-22 11:44:57 +00:00
Julian M. Kunkel b5891141d8 Move checks before inititalization.
Add simple validation for S3.
2020-11-22 11:43:42 +00:00
Julian Kunkel 5d489064d8
Merge pull request #271 from hpc/fix-statvfs
Remove duplicated functionality between mdtest and IOR.
2020-11-13 09:24:24 +00:00
Julian Kunkel 13f9721dbc
Merge pull request #267 from hpc/feature-md-workbench
Feature: md-workbench
2020-11-10 19:05:20 +00:00
Julian M. Kunkel 277f380139 Remove duplicated functionality between mdtest and IOR.
Refactored the ShowFileSystemSize function.
2020-11-09 16:23:34 +00:00
Julian M. Kunkel ad985af763 Location problem on non Linux systems. 2020-11-06 09:30:59 +00:00
otatebe 0e91769328
aiori-Gfarm: sequel to #262 - sync interface (#269)
* aiori-Gfarm: update to the new aiori interface

* aiori-Gfarm: Gfarm_sync
2020-11-06 09:15:39 +00:00
Julian M. Kunkel 2d79efc0c5 Fix wait issue on MacOS 2020-11-05 19:13:08 +00:00
Julian M. Kunkel 75c08386a4 Bugfix porting error for performance stats. 2020-11-04 20:47:30 +00:00
Julian M. Kunkel c0ffdf44d0 Workbench API improved. 2020-11-04 20:25:27 +00:00
Julian M. Kunkel d9c74af8f3 Fix (accidently rename of option) 2020-11-04 19:27:39 +00:00
Julian M. Kunkel b5dfeea82a Remove output for the API. 2020-11-04 18:04:46 +00:00
Julian Kunkel fb66e77072
Enable random seed to be stored. (#268) 2020-11-04 13:47:35 +00:00
Julian M. Kunkel 4e452766b9 Enable random seed to be stored. 2020-11-04 12:48:46 +00:00
Julian M. Kunkel e1dd3103cf Fix make dist for md-workbench. 2020-11-03 10:52:45 +00:00
Mohamad Chaarawi cb397242f9
DAOS backend cleanup (#266)
- remove legacy DAOS driver & update Readme.
- update configure options to remove cart requirement
- Optimize DFS file get_size

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-11-03 10:01:09 +00:00
Julian M. Kunkel 82d20f2744 Basic API converted. 2020-11-02 20:12:15 +00:00
Julian M. Kunkel 654b797788 Converted output to IOR output. 2020-11-02 19:34:15 +00:00
Julian M. Kunkel dc89a59371 Workbench, adjusting the interface to IOR tool interfaces. 2020-11-02 19:23:13 +00:00
Julian M. Kunkel d39ae556f0 Bugfixing md-workbench errors. 2020-11-02 19:04:27 +00:00
Julian M. Kunkel 348754c87a md-workbench code ported. 2020-11-02 18:45:53 +00:00
Julian M. Kunkel 9ace15cce3 Workbench: further conversation. 2020-11-02 17:56:28 +00:00
Julian M. Kunkel c28ed6dc72 Partial conversion of existing md-workbench to IOR APIs. 2020-11-02 17:34:11 +00:00
Julian Kunkel d750d323e3
JSON output. Remove duplicated keys. (#265) 2020-10-28 09:47:38 +00:00
donko dab62b57c8
fix JSON format, the end of Array object (#264) 2020-10-28 09:38:17 +00:00
Jean-Yves VET 077f4ef98d
aiori-IME: Fix init after finalize issue (#263) 2020-10-26 14:37:19 +00:00
otatebe 7bc9680b85
aiori-Gfarm: update to the new aiori interface (#262) 2020-10-26 11:26:10 +00:00
Sebastian Oeste 65ddc53950
CSV output for IOR results (#260)
This commit adds CSV output for IOR.
The output will just include the `Results` section.
All other sections are omitted, since it's hard to produce a useful csv
with all information included.
2020-10-09 09:35:01 +01:00
Julian Kunkel bd76b45ef9
Integrated comparison checks into CompareData() which prevents additi… (#254)
* Integrated comparison checks into CompareData() which prevents additional buffer comparisons at the expense of some computation #249.

* IOR: Added code documentation to warn people for changing the creation pattern but not the verification pattern.
2020-09-28 20:09:48 +01:00
Julian Kunkel 8f14166a79
S3: removed unneded check. (#258) 2020-09-13 09:20:46 +01:00
Julian Kunkel e60801cf8e
Prefix S3 options correctly for S3-libs3 (#257)
* Option renamed to be consistent
2020-09-13 08:52:02 +01:00
Mohamad Chaarawi 7c201c0d9c
HDF5: fix segfault in HDF5 driver after latest AIORI changes (#255)
- the hints structure was not getting initialized in MPIIO when HDF5
backend is used. Since HDF5 utilizes the MPIIO backend, this causes
a segfault.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-09-02 18:12:17 +01:00
Julian Kunkel cc0ac50086
POSIX GFPS adjusted to new API #248 (#253) 2020-09-02 10:08:52 +01:00
Julian Kunkel af2429b47e
Fix s3-4c implementation (#247)
* Ported S3-4c version to current AIORI interface.
* S3-4c: add crypto dependency
* S3: Store username/host in options.
2020-08-13 16:25:36 +01:00
Julian Kunkel 4e2d179052
Detection of system features for number of sockets #245 (#246)
* Configure checks for architecture-specific functions to detect nr of sockets. #245
2020-08-03 12:30:21 +01:00
Julian Kunkel 47b63a8054
Merge pull request #243 from hpc/feature-aio
Feature aio
2020-08-03 10:06:07 +01:00
Julian Kunkel 9f762ecbe0
Merge pull request #244 from mchaarawi/fix_daos_get_size_api
remove comm from get size cb in DAOS driver
2020-07-23 10:55:50 +01:00
Mohamad Chaarawi db3d06ec80 remove comm from get size cb in DAOS driver
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-07-22 19:39:11 +00:00
Julian M. Kunkel e3f302ca53 AIORI AIO check params updated. 2020-07-21 16:50:13 +01:00
Julian M. Kunkel e1741c188a AIO plugin: missing reference to include. 2020-07-21 16:23:25 +01:00
Julian M. Kunkel f275671cc9 AIORI POSIX AIO support. Collect ops until granularity is reached, then submit pending IOs. Synchronize latest on close. Doesn't work with data verification and reuses the existing buffer. The implementation shows the potential AIO may have.
Extract also the POSIX header from AIORI to allow better reuse. #240
2020-07-21 16:18:50 +01:00
Julian M. Kunkel 5e465ac8bf Option: merge function to supported AIORI module reuse. 2020-07-21 13:54:50 +01:00
Julian M. Kunkel 4258e14c11 mdtest: Bugfix of changed behavior, can only remove dir if all children were deleted. 2020-07-21 09:31:19 +01:00
Julian M. Kunkel 8ca388fc78 Merge branch 'feature-cleanup-aiori' 2020-07-21 09:26:03 +01:00
Julian Kunkel b056226077
Merge pull request #238 from jyvet/feature-cleanup-aiori
aiori-IME: Update to new aiori interface
2020-07-03 15:52:32 +01:00
Jean-Yves VET f005147c4d aiori-IME: Update to new aiori interface
This patch updates IME backend to support new aiori interface.
It also fixes some indentation issues.
2020-07-03 16:37:33 +02:00
Julian Kunkel acc9a0cb57
Merge pull request #237 from knweiss/codespell
Spelling fixes (found by codespell)
2020-07-03 10:27:55 +01:00