MD BMG: Difference between revisions

From OpenSFS Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(24 intermediate revisions by 3 users not shown)
Line 1: Line 1:
[[MD_BMG/charter|'''The task of the BWG Metadata Performance Evaluation Effort (MPEE)''']] group is to:
[[Benchmarking_Working_Group|Back to the main BWG page]]
# Build/select tools that will allow evaluation of File System Metadata performance and scalability
# The tools will help detect pockets of Metadata low performance in cases when users complain of extreme slowness  of MD operations
# Benchmark tools will support: POSIX, MPI, and Transactional operations (for CEPH and DAOS)
# Address the very high end HPC as well as small and medium installations benchmark needs
# Tools applicable to Lustre and: CEPH, GPFS…


'''Lead:''' Sorin Fabish <br />
'''Members:''' Branislav Radovanovic, Rick Roloff, Cheng Shao, Wang Yibin, Keith Mannthey, Bobbie Lind, Greg Farnum
<br />


[[MD_BMG/benchmarks|'''Current MPEE proposed list of benchmarks''']]:  
[[MD_BMG/charter|'''The task of the BWG Metadata Performance Evaluation Effort (MPEE)''']] group is to:
<br \> Build/select tools that will allow evaluation of File System Metadata performance and scalability


[[MD_BMG/benchmarks|'''Current MPEE proposed list of benchmarks''']]


[[MD_BMG/Usecases|'''MPEE Usecases''']]
[[MD_BMG/Usecases|'''MPEE Usecases''']]


[[MD_BMG/roadmap|'''MPEE Proposed Roadmap''']]
[[MD_BMG/roadmap|'''MPEE Proposed Roadmap''']]
 
<br />
At SC'13 we will present results of running the 4 benchmark candidates on same system, compare their results,
<br />and discuss their eligibility as proposed benchmarks of MPEE.
<br />
* [http://wiki.opensfs.org/images/4/46/LUG14_MPEE_BWG_OpenSFS.pdf '''Metadata Benchmarks and MD Performance Metrics'''] This presentation was approved to be presented at LUG 2014. Any review is appreciated.([[MD_BMG/LUG-abstract|'''See Abstract''']])
<br />
<br />
 
[[MD_BMG/asks|'''MPEE Asks from OpenSFS''']]:
* At SC'13 we will present results of running the 4 benchmark candidates on same system and compare their results to discuss their eligibility as proposed benchmarks of MPEE.
<br />
<br />
 
Share any open source synthetic benchmarks code
[[MD_BMG/asks|'''MPEE Asks from OpenSFS''']]
* Share any open source synthetic benchmarks code
* Share a list of MD benchmark tools they currently use to allow select the most suitable and used candidates
* Share MD operations tested to allow build Netmist workload objects
* Share the MD workloads that create pain points to Lustre FS
* Share cases of poor MD performance workloads and applications


Return to [[http://wiki.opensfs.org/Benchmarking_Working_Group Benchmarking_Working_Group]] page.
Return to [[http://wiki.opensfs.org/Benchmarking_Working_Group Benchmarking_Working_Group]] page.

Latest revision as of 11:56, 6 March 2015

Back to the main BWG page

Lead: Sorin Fabish
Members: Branislav Radovanovic, Rick Roloff, Cheng Shao, Wang Yibin, Keith Mannthey, Bobbie Lind, Greg Farnum

The task of the BWG Metadata Performance Evaluation Effort (MPEE) group is to:
Build/select tools that will allow evaluation of File System Metadata performance and scalability

Current MPEE proposed list of benchmarks

MPEE Usecases

MPEE Proposed Roadmap
At SC'13 we will present results of running the 4 benchmark candidates on same system, compare their results,
and discuss their eligibility as proposed benchmarks of MPEE.


MPEE Asks from OpenSFS:
Share any open source synthetic benchmarks code

Return to [Benchmarking_Working_Group] page.