Commit Graph

646 Commits (e3f302ca532029ba0e23288b2cae4c44d511668f)

Author SHA1 Message Date
Julian M. Kunkel e3f302ca53 AIORI AIO check params updated. 2020-07-21 16:50:13 +01:00
Julian M. Kunkel e1741c188a AIO plugin: missing reference to include. 2020-07-21 16:23:25 +01:00
Julian M. Kunkel f275671cc9 AIORI POSIX AIO support. Collect ops until granularity is reached, then submit pending IOs. Synchronize latest on close. Doesn't work with data verification and reuses the existing buffer. The implementation shows the potential AIO may have.
Extract also the POSIX header from AIORI to allow better reuse. #240
2020-07-21 16:18:50 +01:00
Julian M. Kunkel 5e465ac8bf Option: merge function to supported AIORI module reuse. 2020-07-21 13:54:50 +01:00
Julian M. Kunkel 4258e14c11 mdtest: Bugfix of changed behavior, can only remove dir if all children were deleted. 2020-07-21 09:31:19 +01:00
Julian M. Kunkel 8ca388fc78 Merge branch 'feature-cleanup-aiori' 2020-07-21 09:26:03 +01:00
Julian Kunkel b056226077
Merge pull request #238 from jyvet/feature-cleanup-aiori
aiori-IME: Update to new aiori interface
2020-07-03 15:52:32 +01:00
Jean-Yves VET f005147c4d aiori-IME: Update to new aiori interface
This patch updates IME backend to support new aiori interface.
It also fixes some indentation issues.
2020-07-03 16:37:33 +02:00
Julian Kunkel acc9a0cb57
Merge pull request #237 from knweiss/codespell
Spelling fixes (found by codespell)
2020-07-03 10:27:55 +01:00
Karsten Weiss f280123d0b Spelling fixes (found by codespell) 2020-07-03 09:16:30 +02:00
Julian M. Kunkel a12ed015a6 S3: better testing, stat is semi-fake, other functions aren't. 2020-07-02 16:40:20 +01:00
Julian M. Kunkel 4f7350dc6a MDTest remove testdir if created by MDTest. 2020-07-02 16:26:05 +01:00
Julian M. Kunkel fb9fa7cc9f S3: Better cleanup. 2020-07-02 15:57:46 +01:00
Julian M. Kunkel fb8f43fcfe Reduce verbosity for verification 2020-07-01 10:05:09 +01:00
Julian M. Kunkel 371335195b Initialize logfile for warnings if not set. 2020-07-01 09:42:13 +01:00
Julian M. Kunkel 484cb420d2 Generate config file with build options 2020-07-01 09:19:10 +01:00
Julian Kunkel 728fa1e0f9
Merge pull request #234 from hpc/feature-write-check
MDTest changed verification pattern.
2020-06-30 20:06:41 +01:00
Julian M. Kunkel fcae6ff0b9 S3: Fine tuning, supporting bucket per file/dir and single bucket. 2020-06-30 20:02:36 +01:00
Julian M. Kunkel 87c9906d70 Error checking for NULL create/opens 2020-06-30 19:41:49 +01:00
Julian M. Kunkel 154cf2cde7 LibS3 version that stores fragments as one object each. 2020-06-30 18:43:44 +01:00
Julian M. Kunkel 2a3838c360 S3: Partial implementation. 2020-06-30 16:50:13 +01:00
Julian M. Kunkel 81a7a3ab81 Renamed existing S3 impl. which uses (apparently) outdated library. Added dummy support for libS3 with library search. 2020-06-30 13:41:59 +01:00
Julian M. Kunkel 3a9bd7828d Ported PMDK API. 2020-06-30 13:12:44 +01:00
Julian M. Kunkel 82417128cd Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI. 2020-06-30 12:33:56 +01:00
Julian M. Kunkel 3395fc621c Moved GetFileSize into CheckFileSize, starting to simplify get_file_size (too much replication in modules). 2020-06-30 12:03:05 +01:00
Julian M. Kunkel 5a5b90cdaa Run existing check to allow only supported backends in mdtest. 2020-06-30 11:17:46 +01:00
Julian M. Kunkel 3e6bfd2db7 Added missing header info. 2020-06-29 20:58:45 +01:00
Julian M. Kunkel 03dbb20594 MDTest changed verification pattern. Read now always checks the first byte/8 bytes for the signature (item number).
Added also --verify-write option which performs a read immediately after a write. Supports #206
2020-06-29 20:15:14 +01:00
Julian M. Kunkel df3f7082d8 MDTest: Added warnings/errors for errorneous read pattern #206 2020-06-28 17:21:24 +01:00
Julian M. Kunkel 145c71f7c3 Trivial cleanup: Extracted debug-related stuff into new header. 2020-06-28 17:16:56 +01:00
Julian M. Kunkel 7edd559c01 Added missing news. 2020-06-28 16:49:57 +01:00
Julian M. Kunkel 3cb144e7f3 Added regression test for JSON #202 2020-06-25 14:44:55 +01:00
Julian M. Kunkel 38b1752bda JSON issue with results. Fix for #233. 2020-06-25 14:37:52 +01:00
Julian M. Kunkel 0bffd14de7 Added --warningAsErrors option to IOR and MDTest and refactored WARNINGs in IOR. #174 2020-06-24 11:13:12 +01:00
Julian M. Kunkel c55848f14d Bugfix based on the pull request for fix-189. Should fix #189. 2020-06-24 10:15:31 +01:00
Julian Kunkel 71874f9b90
Merge pull request #199 from adrianjhpc/master
PMDK backend with dual mount options
2020-06-24 09:50:12 +01:00
Julian Kunkel d5de9bcc77
Merge branch 'master' into master 2020-06-24 09:50:03 +01:00
Julian Kunkel 8faa6c88d6
Merge pull request #195 from jschwartz-cray/fix-194
Fix #194.
2020-06-24 09:43:56 +01:00
Julian Kunkel 6a88b37171
Merge branch 'master' into fix-194 2020-06-24 09:43:37 +01:00
Julian Kunkel 6e507f732c
Merge pull request #225 from hpc/fix-modules
Improve AIORI module behavior
2020-06-24 09:26:19 +01:00
Julian M. Kunkel c105d014b2 Increased version number in preparation of a new release. 2020-06-24 09:23:01 +01:00
Julian Kunkel d483e3bf9d
Merge branch 'rc' into master 2020-06-24 08:58:08 +01:00
Julian Kunkel 39ca1f25fe
Merge pull request #230 from mchaarawi/fix-modules
merge from master
2020-06-11 21:05:52 +01:00
Mohamad Chaarawi b4a54c34e8 Merge branch 'master' into fix-modules
Conflicts:
	src/aiori-DAOS.c
	src/aiori-DFS.c
2020-06-11 19:55:23 +00:00
Julian Kunkel 825dcef337
Merge pull request #229 from mchaarawi/fix-modules
update DFS and DAOS drivers to new aiori module interface.
2020-06-11 20:03:33 +01:00
Mohamad Chaarawi e08314f571 update DFS and DAOS drivers to new aiori module interface.
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
2020-06-11 17:26:58 +00:00
Julian M. Kunkel eb2cd27fac Removed offset from IOR structure. 2020-06-10 17:47:07 +01:00
Glenn K. Lockwood d4d3c72efb
Merge pull request #228 from breuner/fix-mdtest-directio
mdtest: use correct number of bytes for posix_memalign of read buffer
2020-06-02 16:22:58 -07:00
Sven Breuner c828a0f32c mdtest: use correct number of bytes for posix_memalign of read buffer
Fixes a typo in initial posix_memalign commit for DirectIO support.
2020-06-03 01:22:44 +03:00
Glenn K. Lockwood 9f07265d1e
Merge pull request #227 from breuner/fix-mdtest-directio
mdtest: allocate aligned buffers to support DirectIO
2020-06-02 15:06:50 -07:00