0e91769328
aiori-Gfarm: sequel to #262 - sync interface ( #269 )
...
* aiori-Gfarm: update to the new aiori interface
* aiori-Gfarm: Gfarm_sync
2020-11-06 09:15:39 +00:00
fb66e77072
Enable random seed to be stored. ( #268 )
2020-11-04 13:47:35 +00:00
cb397242f9
DAOS backend cleanup ( #266 )
...
- remove legacy DAOS driver & update Readme.
- update configure options to remove cart requirement
- Optimize DFS file get_size
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-11-03 10:01:09 +00:00
d750d323e3
JSON output. Remove duplicated keys. ( #265 )
2020-10-28 09:47:38 +00:00
dab62b57c8
fix JSON format, the end of Array object ( #264 )
2020-10-28 09:38:17 +00:00
077f4ef98d
aiori-IME: Fix init after finalize issue ( #263 )
2020-10-26 14:37:19 +00:00
7bc9680b85
aiori-Gfarm: update to the new aiori interface ( #262 )
2020-10-26 11:26:10 +00:00
65ddc53950
CSV output for IOR results ( #260 )
...
This commit adds CSV output for IOR.
The output will just include the `Results` section.
All other sections are omitted, since it's hard to produce a useful csv
with all information included.
2020-10-09 09:35:01 +01:00
bd76b45ef9
Integrated comparison checks into CompareData() which prevents additi… ( #254 )
...
* Integrated comparison checks into CompareData() which prevents additional buffer comparisons at the expense of some computation #249 .
* IOR: Added code documentation to warn people for changing the creation pattern but not the verification pattern.
2020-09-28 20:09:48 +01:00
8f14166a79
S3: removed unneded check. ( #258 )
2020-09-13 09:20:46 +01:00
e60801cf8e
Prefix S3 options correctly for S3-libs3 ( #257 )
...
* Option renamed to be consistent
2020-09-13 08:52:02 +01:00
7c201c0d9c
HDF5: fix segfault in HDF5 driver after latest AIORI changes ( #255 )
...
- the hints structure was not getting initialized in MPIIO when HDF5
backend is used. Since HDF5 utilizes the MPIIO backend, this causes
a segfault.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-09-02 18:12:17 +01:00
cc0ac50086
POSIX GFPS adjusted to new API #248 ( #253 )
2020-09-02 10:08:52 +01:00
af2429b47e
Fix s3-4c implementation ( #247 )
...
* Ported S3-4c version to current AIORI interface.
* S3-4c: add crypto dependency
* S3: Store username/host in options.
2020-08-13 16:25:36 +01:00
4e2d179052
Detection of system features for number of sockets #245 ( #246 )
...
* Configure checks for architecture-specific functions to detect nr of sockets. #245
2020-08-03 12:30:21 +01:00
47b63a8054
Merge pull request #243 from hpc/feature-aio
...
Feature aio
2020-08-03 10:06:07 +01:00
9f762ecbe0
Merge pull request #244 from mchaarawi/fix_daos_get_size_api
...
remove comm from get size cb in DAOS driver
2020-07-23 10:55:50 +01:00
db3d06ec80
remove comm from get size cb in DAOS driver
...
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-07-22 19:39:11 +00:00
e3f302ca53
AIORI AIO check params updated.
2020-07-21 16:50:13 +01:00
e1741c188a
AIO plugin: missing reference to include.
2020-07-21 16:23:25 +01:00
f275671cc9
AIORI POSIX AIO support. Collect ops until granularity is reached, then submit pending IOs. Synchronize latest on close. Doesn't work with data verification and reuses the existing buffer. The implementation shows the potential AIO may have.
...
Extract also the POSIX header from AIORI to allow better reuse. #240
2020-07-21 16:18:50 +01:00
5e465ac8bf
Option: merge function to supported AIORI module reuse.
2020-07-21 13:54:50 +01:00
4258e14c11
mdtest: Bugfix of changed behavior, can only remove dir if all children were deleted.
2020-07-21 09:31:19 +01:00
8ca388fc78
Merge branch 'feature-cleanup-aiori'
2020-07-21 09:26:03 +01:00
b056226077
Merge pull request #238 from jyvet/feature-cleanup-aiori
...
aiori-IME: Update to new aiori interface
2020-07-03 15:52:32 +01:00
f005147c4d
aiori-IME: Update to new aiori interface
...
This patch updates IME backend to support new aiori interface.
It also fixes some indentation issues.
2020-07-03 16:37:33 +02:00
acc9a0cb57
Merge pull request #237 from knweiss/codespell
...
Spelling fixes (found by codespell)
2020-07-03 10:27:55 +01:00
f280123d0b
Spelling fixes (found by codespell)
2020-07-03 09:16:30 +02:00
a12ed015a6
S3: better testing, stat is semi-fake, other functions aren't.
2020-07-02 16:40:20 +01:00
4f7350dc6a
MDTest remove testdir if created by MDTest.
2020-07-02 16:26:05 +01:00
fb9fa7cc9f
S3: Better cleanup.
2020-07-02 15:57:46 +01:00
fb8f43fcfe
Reduce verbosity for verification
2020-07-01 10:05:09 +01:00
371335195b
Initialize logfile for warnings if not set.
2020-07-01 09:42:13 +01:00
484cb420d2
Generate config file with build options
2020-07-01 09:19:10 +01:00
728fa1e0f9
Merge pull request #234 from hpc/feature-write-check
...
MDTest changed verification pattern.
2020-06-30 20:06:41 +01:00
fcae6ff0b9
S3: Fine tuning, supporting bucket per file/dir and single bucket.
2020-06-30 20:02:36 +01:00
87c9906d70
Error checking for NULL create/opens
2020-06-30 19:41:49 +01:00
154cf2cde7
LibS3 version that stores fragments as one object each.
2020-06-30 18:43:44 +01:00
2a3838c360
S3: Partial implementation.
2020-06-30 16:50:13 +01:00
81a7a3ab81
Renamed existing S3 impl. which uses (apparently) outdated library. Added dummy support for libS3 with library search.
2020-06-30 13:41:59 +01:00
3a9bd7828d
Ported PMDK API.
2020-06-30 13:12:44 +01:00
82417128cd
Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI.
2020-06-30 12:33:56 +01:00
3395fc621c
Moved GetFileSize into CheckFileSize, starting to simplify get_file_size (too much replication in modules).
2020-06-30 12:03:05 +01:00
5a5b90cdaa
Run existing check to allow only supported backends in mdtest.
2020-06-30 11:17:46 +01:00
3e6bfd2db7
Added missing header info.
2020-06-29 20:58:45 +01:00
03dbb20594
MDTest changed verification pattern. Read now always checks the first byte/8 bytes for the signature (item number).
...
Added also --verify-write option which performs a read immediately after a write. Supports #206
2020-06-29 20:15:14 +01:00
df3f7082d8
MDTest: Added warnings/errors for errorneous read pattern #206
2020-06-28 17:21:24 +01:00
145c71f7c3
Trivial cleanup: Extracted debug-related stuff into new header.
2020-06-28 17:16:56 +01:00
7edd559c01
Added missing news.
2020-06-28 16:49:57 +01:00
3cb144e7f3
Added regression test for JSON #202
2020-06-25 14:44:55 +01:00
otatebe