Evolving the Message Passing Interface (MPI) for Future Architectures



8/09/2022 - 11:00 Prof. Dr. Martin Schulz (Technical University of Munich) IMAG 106

The Message Passing Interface (MPI) remains the dominant programming model for large scale parallel systems. However, with changing system architectures from static, homogeneous and monolithical systems to dynamic and heterogeneous system architectures, also MPI must evolve and is evolving to support novel architectures. Last year the MPI forum has published Version 4.0, which contained several new additions for this purpose from better error reporting and handling to supporting hardware topologies, from new ways to initialize MPI in a more scalable fashion to more support for efficient collectives. The MPI Forum is currently continuing its work with the goal of an MPI 5.0 standard that will further extend its capabilities. For the latter, special focus will be on malleability, support for heterogeneous and accelerated programming, as well as full support for fault tolerance. In this talk I will discuss the motivation for these new developments, provide an insight into the current thinking of the MPI Forum for the next version of MPI, and invite everyone interested in participating in the discussion of this ongoing evolution.