vitalif
/
mdtest
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
662 Commits
1 Branch
0 Tags
2.5 MiB
Commit Graph

41 Commits (cb397242f9b896acd3429d3125303a340112b629)

Author SHA1 Message Date
Mohamad Chaarawi cb397242f9
DAOS backend cleanup (#266) 
- remove legacy DAOS driver & update Readme.
- update configure options to remove cart requirement
- Optimize DFS file get_size

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-11-03 10:01:09 +00:00
Julian M. Kunkel 8ca388fc78 Merge branch 'feature-cleanup-aiori' 2020-07-21 09:26:03 +01:00
Karsten Weiss f280123d0b Spelling fixes (found by codespell) 2020-07-03 09:16:30 +02:00
Julian M. Kunkel 82417128cd Extracted file size routine that is replicated in each module into IOR removing the MPI dependency from AIORI. 2020-06-30 12:33:56 +01:00
Mohamad Chaarawi b4a54c34e8 Merge branch 'master' into fix-modules 
Conflicts:
	src/aiori-DAOS.c
	src/aiori-DFS.c
 2020-06-11 19:55:23 +00:00
Mohamad Chaarawi e08314f571 update DFS and DAOS drivers to new aiori module interface. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-06-11 17:26:58 +00:00
Mohamad Chaarawi 3623f3b8bd DFS: allow multiple IO phases when ior_run() is called 
- init/fini can be made multiple times
- reset tunables on fini so they can change on a re-init

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-05-31 16:20:58 +00:00
Mohamad Chaarawi 28fae361f4 dfs: add DFS sync call 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-05-28 18:34:31 +00:00
Mohamad Chaarawi 1b8848ccbc Use l2g-g2l to share the dfs mount instead of opening by each rank. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-04-13 19:59:56 +00:00
Mohamad Chaarawi 50a4ba0735 DAOS Driver: Update License & Align with 1.0 API changes 
- License should inherit from IOR License.
- remove checksums from Array API
- add DFS dir oclass option

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2020-02-26 18:53:51 +00:00
Mohamad Chaarawi acfd4673cc We only need to add dirs to the Hash in the DFS driver. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-11-13 00:09:03 +00:00
Mohamad Chaarawi fbff9b6fb2 add DFS prefix option 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-11-07 18:01:07 +00:00
Mohamad Chaarawi 92180e022d update DFS read/write APIs with new DAOS API changes 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-10-28 16:42:44 +00:00
Mohamad Chaarawi fca0a62ccb update to new DAOS API for creating dfs containers. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-21 22:05:54 +00:00
Mohamad Chaarawi e9dd5fe15e Merge branch 'master' into daos-devel 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	configure.ac
	src/Makefile.am
	src/aiori-MPIIO.c
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest.c
	src/option.c
 2019-09-09 19:55:56 +00:00
Mohamad Chaarawi 57a16ddda8 - update debugging error checking in DFS. 
- remove usleep() before daos_fini()
- fix README

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-09-09 19:14:35 +00:00
Mohamad Chaarawi 32db1cd902 add timing for container close. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-29 03:24:48 +00:00
Mohamad Chaarawi 93730771fd add some verbose messages on finalize routines for DAOS and DFS drivers. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-28 17:01:51 +00:00
Mohamad Chaarawi b3663bd29a add sleep depending on MPI rank to avoid all ranks calling daos_fini() 
at once (issue with PSM2).

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-14 13:32:51 +00:00
Mohamad Chaarawi 1320aa279c add some barriers before cont close and destroy to make sure all 
ranks are done.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-12 16:04:20 +00:00
Mohamad Chaarawi 8cb878507e Add dfs chunk_size and oclass options. 
update dfs_remove for API change.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-12 14:25:05 +00:00
Mohamad Chaarawi f16ef9ace5 update dfs_lookup() call for extra parameter. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-08-03 05:07:13 +00:00
Mohamad Chaarawi 92939e4fbd update for DAOS API changes 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-07-31 17:22:20 +00:00
Mohamad Chaarawi 52ed766df4 update DAOS and DFS drivers to new DAOS API changes. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-07-08 15:33:06 +00:00
Mohamad Chaarawi 2ae7c29de2 cache the parent dir in a hashtable so we don't have to do a lookup 
on every access.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-06-27 21:31:07 +00:00
Mohamad Chaarawi 960005351d update DAOS and DFS markings. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-06-25 22:41:30 +00:00
Mohamad Chaarawi 262d35d87e - Merge branch 'master' into daos-devel 
- fix bugs with cont destroy.
- add destroy option to DFS driver
- share pool and container handle with DFS driver, and allow multi rank access

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	src/ior.c
	src/mdtest.c
	src/option.c
	src/parse_options.c
 2019-06-24 21:26:15 +00:00
Mohamad Chaarawi af1aa627eb use d_ version of function instead of daos_ since some of those are 
going to be removed from the DAOS API.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-06-07 16:59:11 +00:00
Mohamad Chaarawi 8b23c50389 update dfs_open for API change to expose chunk size selection 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-03-22 16:53:34 +00:00
Mohamad Chaarawi db19141c19 remove usage of GURT's D_GOTO from DFS plugin. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-03-01 20:41:01 +00:00
Mohamad Chaarawi 29090df283 update DAOS and DFS drivers with new DAOS API changes. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-02-08 18:00:33 +00:00
Mohamad Chaarawi 2c87b5e0f5 Merge remote-tracking branch 'upstream/master' into daos 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest-main.c
	src/mdtest.c
	src/option.c
 2019-01-24 00:31:12 +00:00
Mohamad Chaarawi d2a0023765 remove epoch usage and rebase with latest DAOS API that switches to transactions. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2019-01-07 18:28:59 +00:00
Mohamad Chaarawi 72c487013a rebase with latest DAOS 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-12-04 22:59:15 +00:00
Mohamad Chaarawi 0a7b1e38ea fix verbose output in DAOS & DFS drivers 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-09-13 13:32:02 +00:00
Mohamad Chaarawi 2668363fb1 - update README for DAOS drivers. 
- update flag options in DAOS API
- make svcl option in DFS API the same as DAOS API

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-08-30 14:47:17 +00:00
Mohamad Chaarawi 46ff4e26be Merge remote branch 'daos-stack/daos' 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>

Conflicts:
	configure.ac
	src/Makefile.am
	src/aiori.c
	src/aiori.h
	src/ior.c
	src/mdtest.c
	src/parse_options.c
 2018-08-29 21:14:19 +00:00
Mohamad Chaarawi 5fb850c810 - update the DFS driver to latest DFS API. 
- update cmd line options to add DAOS Pool and Container uuid and SVCL
- Add init/finalize backend functions.

Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-08-23 21:58:53 +00:00
Mohamad Chaarawi 07ec65c0d5 remoce rank_list_parse as it is exposed by DAOS API now. 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-07-19 21:36:29 +00:00
Mohamad Chaarawi 1768eff552 update DFS plugin 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-06-20 21:25:22 +00:00
Mohamad Chaarawi 8d0cddd21e Add DFS ior/mdtest driver 
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
 2018-06-13 18:37:37 +00:00