Supercomputing Academy: Parallel Programming with MPI

MPI is a communication protocol for parallel programming based on message exchange between individual processes. These processes can be executed on distributed memory systems with multiple nodes. This makes MPI scalable on systems larger than single computers. MPI offers a range of tools to maintain the flow of information between individual processes. This enables the execution of a parallel program that can be divided into several smaller parts. In the course of necessary communication, overhead always occurs, which normally limits the scalability of a parallel program. However, a properly optimized program opens up the possibility of using MPI on a distributed memory system (e.g., cluster or supercomputer) with satisfactory efficiency, where thousands or tens of thousands of nodes can be used. This course also offers the opportunity for intensive exchange with the instructors and other course participants.

Location

Flexible online course: Combination of self-study and live seminars (HLRS Supercomputing Academy)
Organizer: HLRS, University of Stuttgart, Germany

Start date

Nov 04, 2024

End date

Dec 06, 2024

Language

English

Entry level

Basic

Course subject areas

Parallel Programming

Supercomputing Academy

Topics

MPI

Back to list

Prerequisites and content levels

Prerequisites
  • Basic knowledge in C or Fortran
  • Basic knowledge in Linux
  • Basic knowledge in Hardware Understanding
Content levels
  • Beginners: 12 hours
  • Intermediate: 16 hours
  • Advanced: 12 hours

Learn more about course curricula and content levels.

Target audience

This course is intended for, but is not limited to, the following groups:

  • Software developers
  • Software architects
  • Computer scientists
  • IT enthusiasts
  • Simulation engineers

Learning outcomes

Please refer to the course overview.

This course provides scientific training in Computational Science, and in addition, the scientific exchange of the participants among themselves.

Instructor

Dr. Rolf Rabenseifner (HLRS) rolf.rabenseifner(at)hlrs.de

Agenda

  • Week 1: The Beginners' MPI
    Introduce the fundamentals of MPI, including the process model, basic communication techniques, and non blocking communication.
  • Week 2: Beginner & Intermediate MPI
    Dive deeper into intermediate MPI concepts, including collective communication, error handling, derived datatypes, and virtual topologies.
  • Week 3: Advanced MPI - Part 1
    Explore advanced MPI topics, including one-sided communication, shared memory communication, and synchronization rules.
  • Week 4: Advanced MPI - Part 2
    Continue with advanced MPI topics, focusing on collective communications, communicators, and virtual topologies.

Registration-information

Register via the button at the top of this page.
We encourage you to register to the waiting list if the course is full. Places might become available.

Registration closes on October 28, 2024.

Fees

  • Students without master’s degree or equivalent: 40 Euro
  • PhD students or employees at a German university or public research institute: 90 Euro
  • PhD students or employees at a university or public research institute in an EU, EU-associated or PRACE country other than Germany: 180 Euro
  • PhD students or employees at a university or public research institute outside of EU, EU-associated or PRACE countries: 360 Euro
  • Other participants, e.g., from industry, other public service providers, or government: 960 Euro

Link to the EU and EU-associated (Horizon Europe), and PRACE countries.

HLRS concept for flexible learning

Flexible Learning

This course offers flexible learning, allowing you to learn at your own pace and access online course materials and cluster resources. Web-seminars are held weekly to discuss the learning modules and to answer your questions. We also provide forum channels that enable you to communicate with the lecturer and peers, as well as to share your experiences.

Learning Duration

The course is divided into multiple learning units of 10 hours each. Participants can learn the individual learning content on their own schedule. In addition, this course has fixed dates for virtual seminars and the exam.

Certificate & Attendance Confirmation

High-Performance Computing Center (HLRS) issues participants an attendance confirmation if they have attended all seminars, as well as a certificate if they have passed the exam at the end of the course.

Technical Requirement
  • Stable Internet connection so you can access and download the learning materials.
  • Access to video conferencing tool with camera and microphone for participation in regular seminars.

Contact

Tibor Doepper, phone 0711 685 87233, training(at)hlrs.de

HLRS Training Collaborations in HPC

HLRS is part of the Gauss Centre for Supercomputing (GCS), together with JSC in Jülich and LRZ in Garching near Munich. EuroCC@GCS is the German National Competence Centre (NCC) for High-Performance Computing. HLRS is also a member of the Baden-Württemberg initiative bwHPC.

Further courses

See the training overview and the Supercomputing Academy pages.

Related training

All training

December 02 - 05, 2024

Online by JSC


January 13 - 31, 2025

Hybrid Event - Stuttgart, Germany


January 21 - 23, 2025

Hybrid Event - Stuttgart, Germany


February 17 - 21, 2025

Stuttgart, Germany


March 17 - 21, 2025

Dresden, Germany