vitalif
/
mdtest
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
810 Commits
1 Branch
0 Tags
2.5 MiB
Commit Graph

45 Commits (6445267e1057851f49c7a4b677a38a76095bbaad)

Author SHA1 Message Date
Julian M. Kunkel 40c6d97e72 Replaced MPI_COMM_WORLD where needed with testComm. 2021-01-20 14:35:06 +00:00
Mohamad Chaarawi fa316d5d24
dfs: conditionally compile out svcl setting (#313) 
The SVCL argument is being removed from the DAOS API, so conditionally
compile out while maintaining backwards compatibility to versions where
 it's still required.
 2021-01-19 13:43:01 +00:00
Mohamad Chaarawi 6675cd50bf aiori-DFS: stat should not be fatal 
ior now expects stat to not be fatal. update the DFS driver to not
exit if stat fails since the file can simply not exist.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-12-16 15:41:58 +00:00
Mohamad Chaarawi 938cf2771b DFS: make use of collective open to share file handle 
- remove un-needed libdaos_common lib since DAOS driver is removed
- use default container object class when it's not specified

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-12-01 21:36:25 +00:00
Mohamad Chaarawi cb397242f9
DAOS backend cleanup (#266) 
- remove legacy DAOS driver & update Readme.
- update configure options to remove cart requirement
- Optimize DFS file get_size

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-11-03 10:01:09 +00:00
Julian M. Kunkel 8ca388fc78 Merge branch 'feature-cleanup-aiori' 2020-07-21 09:26:03 +01:00
Karsten Weiss f280123d0b Spelling fixes (found by codespell) 2020-07-03 09:16:30 +02:00
Julian M. Kunkel 82417128cd Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI. 2020-06-30 12:33:56 +01:00
Mohamad Chaarawi b4a54c34e8 Merge branch 'master' into fix-modules 
Conflicts:
	src/aiori-DAOS.c
	src/aiori-DFS.c
 2020-06-11 19:55:23 +00:00
Mohamad Chaarawi e08314f571 update DFS and DAOS drivers to new aiori module interface. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-06-11 17:26:58 +00:00
Mohamad Chaarawi 3623f3b8bd DFS: allow multiple IO phases when ior_run() is called 
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-05-31 16:20:58 +00:00
Mohamad Chaarawi 28fae361f4 dfs: add DFS sync call 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-05-28 18:34:31 +00:00
Mohamad Chaarawi 1b8848ccbc Use l2g-g2l to share the dfs mount instead of opening by each rank. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-04-13 19:59:56 +00:00
Mohamad Chaarawi 50a4ba0735 DAOS Driver: Update License & Align with 1.0 API changes 
- License should inherit from IOR License.
- remove checksums from Array API
- add DFS dir oclass option

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-02-26 18:53:51 +00:00
Mohamad Chaarawi acfd4673cc We only need to add dirs to the Hash in the DFS driver. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-11-13 00:09:03 +00:00
Mohamad Chaarawi fbff9b6fb2 add DFS prefix option 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-11-07 18:01:07 +00:00
Mohamad Chaarawi 92180e022d update DFS read/write APIs with new DAOS API changes 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-10-28 16:42:44 +00:00
Mohamad Chaarawi fca0a62ccb update to new DAOS API for creating dfs containers. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-21 22:05:54 +00:00
Mohamad Chaarawi e9dd5fe15e Merge branch 'master' into daos-devel 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	configure.ac
	src/Makefile.am
	src/aiori-MPIIO.c
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest.c
	src/option.c
 2019-09-09 19:55:56 +00:00
Mohamad Chaarawi 57a16ddda8 - update debugging error checking in DFS. 
- remove usleep() before daos_fini()
- fix README

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-09 19:14:35 +00:00
Mohamad Chaarawi 32db1cd902 add timing for container close. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-29 03:24:48 +00:00
Mohamad Chaarawi 93730771fd add some verbose messages on finalize routines for DAOS and DFS drivers. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-28 17:01:51 +00:00
Mohamad Chaarawi b3663bd29a add sleep depending on MPI rank to avoid all ranks calling daos_fini() 
at once (issue with PSM2).

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-14 13:32:51 +00:00
Mohamad Chaarawi 1320aa279c add some barriers before cont close and destroy to make sure all 
ranks are done.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-12 16:04:20 +00:00
Mohamad Chaarawi 8cb878507e Add dfs chunk_size and oclass options. 
update dfs_remove for API change.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-12 14:25:05 +00:00
Mohamad Chaarawi f16ef9ace5 update dfs_lookup() call for extra parameter. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-03 05:07:13 +00:00
Mohamad Chaarawi 92939e4fbd update for DAOS API changes 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-07-31 17:22:20 +00:00
Mohamad Chaarawi 52ed766df4 update DAOS and DFS drivers to new DAOS API changes. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-07-08 15:33:06 +00:00
Mohamad Chaarawi 2ae7c29de2 cache the parent dir in a hashtable so we don't have to do a lookup 
on every access.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-06-27 21:31:07 +00:00
Mohamad Chaarawi 960005351d update DAOS and DFS markings. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-06-25 22:41:30 +00:00
Mohamad Chaarawi 262d35d87e - Merge branch 'master' into daos-devel 
- fix bugs with cont destroy.
- add destroy option to DFS driver
- share pool and container handle with DFS driver, and allow multi rank access

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	src/ior.c
	src/mdtest.c
	src/option.c
	src/parse_options.c
 2019-06-24 21:26:15 +00:00
Mohamad Chaarawi af1aa627eb use d_ version of function instead of daos_ since some of those are 
going to be removed from the DAOS API.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-06-07 16:59:11 +00:00
Mohamad Chaarawi 8b23c50389 update dfs_open for API change to expose chunk size selection 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-03-22 16:53:34 +00:00
Mohamad Chaarawi db19141c19 remove usage of GURT's D_GOTO from DFS plugin. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-03-01 20:41:01 +00:00
Mohamad Chaarawi 29090df283 update DAOS and DFS drivers with new DAOS API changes. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-02-08 18:00:33 +00:00
Mohamad Chaarawi 2c87b5e0f5 Merge remote-tracking branch 'upstream/master' into daos 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest-main.c
	src/mdtest.c
	src/option.c
 2019-01-24 00:31:12 +00:00
Mohamad Chaarawi d2a0023765 remove epoch usage and rebase with latest DAOS API that switches to transactions. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-01-07 18:28:59 +00:00
Mohamad Chaarawi 72c487013a rebase with latest DAOS 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-12-04 22:59:15 +00:00
Mohamad Chaarawi 0a7b1e38ea fix verbose output in DAOS & DFS drivers 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-09-13 13:32:02 +00:00
Mohamad Chaarawi 2668363fb1 - update README for DAOS drivers. 
- update flag options in DAOS API
- make svcl option in DFS API the same as DAOS API

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-08-30 14:47:17 +00:00
Mohamad Chaarawi 46ff4e26be Merge remote branch 'daos-stack/daos' 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	configure.ac
	src/Makefile.am
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest.c
	src/parse_options.c
 2018-08-29 21:14:19 +00:00
Mohamad Chaarawi 5fb850c810 - update the DFS driver to latest DFS API. 
- update cmd line options to add DAOS Pool and Container uuid and SVCL
- Add init/finalize backend functions.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-08-23 21:58:53 +00:00
Mohamad Chaarawi 07ec65c0d5 remoce rank_list_parse as it is exposed by DAOS API now. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-07-19 21:36:29 +00:00
Mohamad Chaarawi 1768eff552 update DFS plugin 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-06-20 21:25:22 +00:00
Mohamad Chaarawi 8d0cddd21e Add DFS ior/mdtest driver 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-06-13 18:37:37 +00:00