Höchstleistungsrechenzentrum Stuttgart: AMD Instinct™ GPU Training

Prerequisites and content levels

Prerequisites

Some knowledge in GPU and/or HPC programming. Participants should have an application developer's general knowledge of computer hardware, operating systems, and at least one HPC programming language.

See also the suggested prereading below (resources and public videos).

Content levels

Basic: 1 hours
Intermediate: 7 hours
Advanced: 6 hours

Learn more about course curricula and content levels.

Resources

Book on HIP programming - Porting CUDA
- Accelerated Computing with HIP, Yifan Sun, Trinayan Baruah, David R Kaeli,
  ISBN-13: ‎ 979-8218107444
Book on OpenMP GPU programming
- Programming Your GPU with OpenMP, Tom Deakin and Tim Mattson,
  ISBN-13: ‎ 978-0262547536
Book of parallel and high performance computing topics
- Parallel and High Performance Computing, Manning Publications, Robert Robey and Yuliana Zamora,
  ISBN-13: ‎ 978-0262547536
ENCCS resources
- Developing Applications with the AMD ROCm
AMD Lab Notes series on GPUOpen.com
- Finite difference method - Laplacian part 1
- Finite difference method - Laplacian part 2
- Finite difference method - Laplacian part 3
- Finite difference method - Laplacian part 4
- AMD matrix cores
- Introduction to profiling tools for AMD hardware
- AMD ROCm™ installation
- AMD Instinct™ MI200 GPU memory space overview
- Register pressure in AMD CDNA2™ GPUs
- GPU-Aware MPI with ROCm
- Creating a PyTorch/TensorFlow Code Environment on AMD GPUs
- Jacobi Solver with HIP and OpenMP offloading
- Sparse matrix vector multiplication - part 1
Quick start guides at Oak Ridge National Laboratory
- Crusher quick-start guide
- Frontier user guide

Instructors

Bob Robey, AMD Global Training Lead for Data Center GPUs

Additional AMD Staff.

Learning outcomes

After this course, participants will

have learned about the many GPU programming languages for AMD GPUs
understand how to get performance scaling
have gained knowledge about the AMD programming tools
have gotten an introduction to the AMD Machine learning software
know about profiling and debugging.

Agenda (subject to change)

All times are CEST.

Day 1 (Mon) - AMD Programming Model, OpenMP and MPI

12:45 - 13:00 Drop in to Zoom

13:00 HLRS Intro
13:10 AMD Presentation Roadmap and Introduction to the System for Exercises
13:20 Programming Model for MI200 and MI300 series
13:45 Programming Model Exercises
14:00 Break
14:10 Introduction OpenMP® Offloading
14:40 OpenMP® Exercises
14:55 Break
15:10 Real-World OpenMP® Language Constructs
15:45 OpenMP® Language Constructs Exercises
16:00 Advanced OpenMP® - zero-copy, debugging and optimization
16:30 Advanced OpenMP® Exercises
16:50 Wrapup

Day 2 (Tue) - MPI and HIP and interoperability

12:45 - 13:00 Drop in to Zoom

13:00 HIP and ROCm
14:00 HIP Exercises
14:15 Break
14:30 Porting code to HIP
14:50 Porting Exercises
15:00 Optimizing HIP Code
15:40 HIP Optimization Exercises
16:00 Break
16:15 OpenMP® and HIP Interoperability
16:40 Interoperability Exercises
16:55 Wrapup

Day 3 (Wed) - Performance Portable languages, C++ Std Par, MPI and Machine Learning

12:45 - 13:00 Drop in to Zoom

13:00 Performance Portability Frameworks; Intro to Kokkos
13:30 Kokkos Exercises
13:50 Break
14:00 C++ Standard Parallelism
14:30 C++ Std Par Exercises
14:50 Break
15:00 GPU-Aware MPI on AMD GPUs
15:30 MPI Exercises
15:50 Break
16:00 ML/AI on AMD GPUs
16:30 ML/AI Exercises
16:55 Wrapup

Day 4 (Thu) - AMD Debuggers and Profiling Tools

12:45 - 13:00 Drop in to Zoom

13:00 Debugging with Rocgdb
13:40 Rocgdb Exercises
14:00 Break
14:15 GPU Profiling - Performance Timelines
14:55 Timeline Profiling Exercises
15:15 Break
15:30 Kernel Profiling with rocprof-compute
16:15 Kernel Profiling Exercises
16:45 Additional Training Resources
16:55 Wrapup

Registration information

Register via the button at the top of this page.
We encourage you to register to the waiting list if the course is full. Places might become available.

Please be aware that the talks and Q'n'A sessions will be recorded. You declare that you are aware of and consent to the recording by registering.

Registration closes on April 20, 2025.

Fees

This course is free of charge.

Contact

Tobias Haas phone 0711 685 87223, training(at)hlrs.de

HLRS Training Collaborations in HPC

HLRS is part of the Gauss Centre for Supercomputing (GCS), together with JSC in Jülich and LRZ in Garching near Munich. EuroCC@GCS is the German National Competence Centre (NCC) for High-Performance Computing. HLRS is also a member of the Baden-Württemberg initiative bwHPC.

Further courses

See the training overview and the Supercomputing Academy pages.