BOOTCAMP: AI profiling

This Bootcamp will be held online with Zoom. Cluster dry run already on Tue, July 8.

The Profiling AI Software Bootcamp covers the process and tools needed to profile AI and machine learning applications to fully utilize high-performance systems. Attendees will learn to profile applications using NVIDIA Nsight™ Systems, a system-wide performance analysis tool; analyze and identify optimization opportunities; and improve performance of applications to scale efficiently across systems of any quantity or size of CPUs and GPUs. Additionally, this bootcamp will walk through the system topology to learn the dynamics of multi-GPU and multi-node connections and architecture

The Bootcamp is co-organised by HLRS, JSC, LRZ, VSC Vienna, Cyfronet AGH, IT4Innovations, RISE, LiU, OpenACC.org and NVIDIA for EuroCC Austria, EuroCC Czechia, EuroCC Poland, EuroCC Montenegro, SLING, EuroCC@GCS and EuroCC Sweden, all National Competence Centres for High-Performance Computing.

Location

Online course
Organizer: HLRS, University of Stuttgart, Germany

Start date

Jul 09, 2025
09:00

End date

Jul 10, 2025
13:30

Language

English

Entry level

Advanced

Course subject areas

Bootcamp/Hackathon

Topics

Artificial Intelligence

Code Optimization

GPU Programming

Machine Learning

Back to list

Prerequisites and content levels

Prerequisites
  • Basic experience with Python programming and PyTorch distributed training
Content levels
  • Advanced level: 9 hours

Learn more about course curricula and content levels.

Instructors

Main lecturer: Tosin Adesuyi (NVIDIA)

 

Agenda

------ PRELIMINARY AGENDA ------ 

CEST time:

Day 0 (Mon, July 8): Cluster Dry Run

  • 11:30  - 12:00 Cluster Dry Run Session

Day 1 (Wed, July 9): GPU profiling

  • 09:00 - 09:15 Welcome (Moderator)
  • 09:15 - 09:30 Connecting to a cluster
  • 09:30 - 10:00 Overview of NVIDIA Grace Hopper™ Architecture  (Lecture)
  • 10:00 - 12:00 Overview of NVIDIA Nsight Systems (Lecture)
  • 12:00 - 13:00 GPU profiling (Lecture and Lab)
  • 13:00 - 13:30 Wrap up and Q&A

Day 2 (Thu, July 10): Advanced Topics

  • 09:00 - 10:30 Distributed Data Parallelism (Lecture and Lab)
  • 10:30 - 12:15 Distributed Model Parallelism (Lecture and Lab)
  • 12:15 - 12:30 Wrap up and QA

Registration information

Registration will be open soon.

The final participants will be selected and informed after the registration deadline has passed.

This course is offered in cooperation by HLRS, JSC, LRZ, VSC Vienna, Cyfronet AGH, IT4Innovations, RISE, LiU, OpenACC.org and NVIDIA. Registration is done via www.gpuhackathons.org hosted by OpenACC-Standard.org. Your registration data will be transferred to these partners. For legal notes see the Privacy Policy.

Registration closes on July 11, 2025 at 23:55.

Fees

  • Students without Master's degree or equivalent. Participants from EU or EuroCC countries only: 0 EUR
  • PhD students or employees at a German university or public research institute: 0 EUR
  • PhD students or employees at a university or public research institute in an EU or EuroCC country other than Germany: 0 EUR.
  • Other participants, e.g., from industry, other public service providers, or government. Participants from EU or EuroCC countries only: 0 EUR

Our course fee includes coffee breaks (in classroom courses only).

For lists of EU and EuroCC countries have a look at the Horizon Europe and EuroCC website.

Only participants from institutions belonging to these countries can take part in this course.

Contact

Maksym Deliyergiyev phone 0711 685 87261, maksym.deliyergiyev(at)hlrs.de

HLRS Training Collaborations in HPC

HLRS is part of the Gauss Centre for Supercomputing (GCS), together with JSC in Jülich and LRZ in Garching near Munich. EuroCC@GCS is the German National Competence Centre (NCC) for High-Performance Computing. HLRS is also a member of the Baden-Württemberg initiative bwHPC.

This course is provided within the framework of EuroCC2.

Acknowledgements

Within the scope of the EuroCC2 project this training is offered free of charge. By participating in a training free of charge, companies receive state-aid corresponding to the regular market-prices listed in the service portfolio. Please note state-aid regulations in Germany.

EuroCC 2 and EuroCC4SEE have received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101101903 and No 101191697. The JU receives support from the European Union’s Digital Europe Programme and Germany, Bulgaria, Austria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Greece, Hungary, Ireland, Italy, Lithuania, Latvia, Poland, Portugal, Romania, Slovenia, Spain, Sweden, France, Netherlands, Belgium, Luxembourg, Slovakia, Norway, Türkiye, Republic of North Macedonia, Iceland, Montenegro, Serbia, Bosnia and Herzegovina.

Further courses

See the training overview and the Supercomputing Academy pages.

Related training

All training

April 08 - 09, 2025

Online


May 05 - 08, 2025

Online


May 09 - 23, 2025

Hybrid Event - Stuttgart, Germany


May 27 - 28, 2025

Online


June 03 - 24, 2025

Online (flexible)


June 17 - 18, 2025

Online


November 10 - 14, 2025

Online