STAR-MPI: Self tuned adaptive routines for MPI collective operations

Ahmad Faraj, Xin Yuan, David Lowenthal

Research output: Chapter in Book/Report/Conference proceedingConference contribution

73 Scopus citations

Abstract

Message Passing Interface (MPI) collective communication routines are widely used in parallel applications. In order for a collective communication routine to achieve high performance for different applications on different platforms, it must be adaptable to both the system architecture and the application workload. Current MPI implementations do not support such software adaptability and are not able to achieve high performance on many platforms. In this paper, we present STAR-MPI (Self Tuned Adaptive Routines for MPI collective operations), a set of MPI collective communication routines that are capable of adapting to system architecture and application workload. For each operation, STAR-MPI maintains a set of communication algorithms that can potentially be efficient at different situations. As an application executes, a STAR-MPI routine applies the Automatic Empirical Optimization of Software (AEOS) technique at run time to dynamically select the best performing algorithm for the application on the platform. We describe the techniques used in STAR-MPI, analyze STAR-MPI overheads, and evaluate the performance of STAR-MPI with applications and benchmarks. The results of our study indicate that STAR-MPI is robust and efficient. It is able to and efficient algorithms with reasonable overheads, and it out-performs traditional MPI implementations to a large degree in many cases.

Original languageEnglish (US)
Title of host publicationProceedings of the 20th Annual International Conference on Supercomputing, ICS 2006
Pages199-208
Number of pages10
DOIs
StatePublished - 2006
Externally publishedYes
Event20th Annual International Conference on Supercomputing, ICS 2006 - Cairns, Queensland, Australia
Duration: Jun 28 2006Jul 1 2006

Publication series

NameProceedings of the International Conference on Supercomputing

Other

Other20th Annual International Conference on Supercomputing, ICS 2006
Country/TerritoryAustralia
CityCairns, Queensland
Period6/28/067/1/06

ASJC Scopus subject areas

  • General Computer Science

Fingerprint

Dive into the research topics of 'STAR-MPI: Self tuned adaptive routines for MPI collective operations'. Together they form a unique fingerprint.

Cite this