Höchstleistungsrechenzentrum Stuttgart

AMD Instinct™ GPU Training

All communication will be done through Zoom, Slack and email.

This course will give a deep dive into the AMD Instinct™ GPU architecture and its ROCm™ ecosystem, including the tools to develop or port HPC or AI applications to AMD GPUs. Participants will be introduced to the HIP (Heterogeneous-computing Interface for Portability) programming language for AMD GPUs, other higher-level GPU programming models such as OpenMP, OpenACC, and performance portable programming models such as Kokkos.
In addition, there will be presentations on other important topics such as GPU-Aware MPI, and Affinity. The AMD tool suite, including the debugger, rocgdb, and the profiling tools rocprof, omnitrace, and omniperf will also be covered. A short introduction will be given into the AMD Machine Learning software stack including PyTorch and Tensorflow and how they have been used in HPC.

After this course, participants will

  • have learned about the many GPU programming languages for AMD GPUs
  • understand how to get performance scaling
  • have gained knowledge about the AMD programming tools
  • have gotten an introduction to the AMD Machine learning software
  • know about profiling and debugging.

Veranstaltungsort

Online course
Organizer: HLRS, University of Stuttgart, Germany

Veranstaltungsbeginn

25. Sept. 2023
13:00

Verstaltungsende

28. Sept. 2023
17:00

Sprache

Englisch

Einstiegslevel

Mittel

Themenbereiche

Daten in HPC / Deep Learning / Maschinelles Lernen

Paralleles Programmieren

Performance-Optimierung & Debugging

Themen

Code-Optimierung

GPU-Programmierung

Maschinelles Lernen

OpenMP

Zurück zur Liste

Prerequisites and content levels

Prerequisites

Some knowledge in GPU and/or HPC programming. Participants should have an application developer's general knowledge of computer hardware, operating systems, and at least one HPC programming language.

See also the suggested prereading below (resources and public videos).

Content levels

Basic: 1 hours
Intermediate: 7 hours
Advanced: 6 hours

Learn more about course curricula and content levels.

Resources
  • Book on HIP programming - Porting CUDA
    • Accelerated Computing with HIP,  Yifan Sun, Trinayan Baruah, David R Kaeli,
      ISBN-13 ‏ : ‎ 979-8218107444
  • ENCCS resourses

  • LAB-NOTE series on GPUOpen.com

    • Finite difference method - Laplacian part 1
    • Finite difference method - Laplacian part 2
    • AMD matrix cores
    • Introduction to profiling tools for AMD hardware
    • AMD ROCm™ installation
    • AMD Instinct™ MI200 GPU memory space overview 

  • Quick start guides at Oak Ridge National Laboratory

Instructors

Bob Robey, Essam Morsi, George Markomanolis (AMD)

Agenda (subject to change)

All times are CEST.
Day 1

12:45 - 13:00 Drop in to Zoom

  • 13:00 HLRS Intro
  • 13:15 AMD Presentation Roadmap
  • 13:25 Introduction to the System for Exercises
  • 13:50 Introduction to the AMD Architecture, including FPGA
  • 14:10 Overview of ROCm and Compilers, Infinity
              Hub/HPC Community
  • 14:30 Break
  • 14:40 Introduction to HIP
  • 15:40 HIP Exercises
  • 16:00 Break
  • 16:15 Porting applications to HIP
  • 16:40 Porting exercises
  • 16:55 Wrapup
Day 2 - Additional GPU Programming Languages

12:45 - 13:00 Drop in to Zoom

  • 13:00 Introduction to OpenMP®
  • 13:50 OpenMP® Exercises
  • 14:30 Break
  • 15:00 Advanced OpenMP® and Mixing HIP and OpenMP®
  • 16:00 Break
  • 16:10 Performance Portability Frameworks; Intro to Kokkos
  • 16:40 Kokkos Exercises
  • 16:55 Wrapup
Day 3 - AMD Performance Considerations and Debugging

12:45 - 13:00 Drop in to Zoom

  • 13:00 AMD Communication Fabrics and GPU-Aware MPI
  • 13:30 GPU-Aware Exercises
  • 13:45 Break
  • 13:55 AMD Node Memory Model
  • 14:35 Memory Model Exercises
  • 14:50 Break
  • 15:00 Affinity - Placement, Ordering and Binding
  • 15:40 Affinity Exercises
  • 16:00 Debuggers - rocgdb
  • 16:40 Rocgdb exercises
  • 16:55 Wrapup
Day 4 - AMD Profilers and Machine Learning

12:45 - 13:00 Drop in to Zoom

  • 13:00 Introduction to rocprof
  • 13:20 Rocprof Exercises
  • 13:30 Introduction to Omnitrace
  • 14:00 Omnitrace Exercises
  • 14:15 Introduction to Omniperf
  • 14:40 Omniperf Exercises
  • 14:50 Break
  • 15:00 Machine Learning in HPC; Introduction to ML on AMD
  • 15:30 Examples of Machine Learning projects
  • 16:55 Wrapup

Registration information

Register via the button at the top of this page.
We encourage you to register to the waiting list if the course is full. Places might become available.

Registration will end on September 8, 2023 at 11:59 PM.

Fees

This course is free of charge.

Contact

Khatuna Kakhiani phone 0711 685 65796, kakhiani(at)hlrs.de
Lorenzo Zanon phone 0711 685 63824, zanon(at)hlrs.de

HLRS Training Collaborations in HPC and AI

HLRS is part of the Gauss Centre for Supercomputing (GCS), together with JSC in Jülich and LRZ in Garching near Munich. EuroCC@GCS is the German National Competence Centre (NCC) for High-Performance Computing. HLRS is also a member of the Baden-Württemberg initiative bwHPC. Since 2025, HLRS coordinates HammerHAI. 

Further courses

See the training overview and the Supercomputing Academy pages.

Ähnliche Trainingskurse
Alle Trainingskurse

Okt. 28 - 31, 2025

Stuttgart

Englisch

Multi-GPU Deep Learning

Nov. 11 - 20, 2025

Online

Englisch

GPU Programming using CUDA

Nov. 20 - Dez. 05, 2025

Hybrid, Stuttgart

Englisch

Hackathon: Porting and Optimization for Hunter

Dez. 01 - 04, 2025

Online

Englisch

Advanced Parallel Programming with MPI and OpenMP

Jan. 12 - 16, 2026

Hybrid, Garching

Englisch

GENE/GENE-X user training and tutorial

Jan. 20 - 29, 2026

Online

Englisch

GPU Programming using CUDA

Jan. 26 - Feb. 06, 2026

Online (flexible)

Englisch

Supercomputing Academy - Introduction to OpenMP

Feb. 10 - 12, 2026

Hybrid, Stuttgart

Englisch

Hybrid Programming in HPC – MPI+X

März 23 - 27, 2026

Hybrid, Stuttgart

Englisch

Iterative Linear Solvers and Parallelization

Zurück zur Liste

Höchstleistungsrechenzentrum Stuttgart Nobelstraße 19, 70569 Stuttgart, Deutschland

Kontakt & Standort

+49 711 685-87269 info(at)hlrs.de

Als Mitglied des Gauss Centre for Supercomputing ist das HLRS eines der drei Bundes­höchst­leistungs­rechen­zentren.

www.gauss-centre.eu

Das HLRS ist eine zentrale Einrichtung der Universität Stuttgart.

www.uni-stuttgart.de

© 2025 HLRS. Alle Rechte vorbehalten.