Hero Run Best Practices: Difference between revisions

From OpenSFS Wiki
Jump to navigation Jump to search
No edit summary
Line 14: Line 14:
* Comparing vendors offerings, or maintaining a database of results.
* Comparing vendors offerings, or maintaining a database of results.


==== Zero to Hero ====
[[Zero to Hero|Hero-Run-Zero-to-Hero]]


==== Tools ====
==== Tools ====
For testing standard POSIX-compliant filesystems, IOR will be used along with an MPI infrastructure.  IOR is available [http://sourceforge.net/projects/ior-sio/ Here] .  Client allocation in the cluster is up to the team performing the test.
For testing standard POSIX-compliant filesystems, IOR will be used along with an MPI infrastructure.  IOR is available [http://sourceforge.net/projects/ior-sio/ Here] .  Client allocation in the cluster is up to the team performing the test.


==== Peak Streaming Performance ====
[[IOR Tests|Hero-run-IOR-tests]]
 
Base test:  mpirun -np {NP} -wd {Working Dir} -machinefile {Machine File} {IOR Pathname}/IOR -v -a POSIX -i5 -g -e -w -r -b 3600g -T 10 -F -C -t 4m
 
Where:
  {NP} is Total number of threads in the test
  {Working Dir} is the directory where files get created
  {Machine File} is a list of clients involved in the test, this is either created by hand, or by a scheduler
  {IOR Pathname} The full path to IOR, this must be accessible on all clients

Revision as of 07:43, 12 June 2014

The Hero Run team is tasked with:

  • Establishing a process to determine the peak streaming performance of a clustered filesystem (both read and write)
  • Describing what the test is doing, and detailing why we chose it over other options
  • Providing an optional form to detail the system that was tested (servers, targets, interconnect, clients, etc.)

The Hero Run team is optionally tasked with:

  • Establishing a process to determine the peak random I/O performance of a clustered filesystem (both read and write)
  • Describing what the test is doing, and detailing why we chose it over other options
  • Establishing an algorithm to combine Streaming read+write, Random read+write into a single number.

The Hero Run team is not tasked with:

  • Creating a Top500 list
  • Determining scaling (though the tests can be used to establish that)
  • Comparing vendors offerings, or maintaining a database of results.

Zero to Hero

Hero-Run-Zero-to-Hero

Tools

For testing standard POSIX-compliant filesystems, IOR will be used along with an MPI infrastructure. IOR is available Here . Client allocation in the cluster is up to the team performing the test.

Hero-run-IOR-tests