
Lecture 9 of 75 · High Performance Scientific Computing
Shivasubramanian Gopalakrishnan
High Performance Scientific Computing · 75 lectures
75 lectures
Introduction to High Performance Scientific Computing
Introduction to Operating System
Linux Kernel Explained
Mastering Linux Directory and File Management
Understanding File Permissions and Ownership in Linux
Mastering Linux Text Processing and File Management
Linux Memory and Networking Commands
Understanding Shell Scripting
Shell Scripting Tutorial for Beginners
Introduction to High-Performance Computing (HPC) and Its Key
Exploring Computing Platform Architecture and CPU Optimization
Hierarchical Memory Systems and Scalable Architectures
Concurrency and Synchronization in Parallel Programming
Need for Parallel Computing
Role of Numerical Models in Solving complex problems
Common Challenges with Memory in Computer Architecture
Organization of hardware in Large HPC systems
Architecture of Nvidia’s Grace Hopper Superchip
Introduction to Shared Memory Programming using OpenMP
Distribution of work using multiple OpenMP Threads
Synchronization and Parallel Loops in OpenMP
Storage attributes of different variables in OpenMP
OpenMP Memory Model, Irregular Parallelism, and Tasks
Parallelization of example codes using OpenMP - Part 1
Parallelization of example codes using OpenMP - Part 2
Introduction to Message Passing Interface (MPI)
Sending and Receiving the messages using MPI
Collective Communication in MPI
Domain Decomposition
Parallelization of example code using MPI
Performance Analysis Frameworks for Parallel Programming
Examples of Collective Communication in MPI: Part 1
Examples of Collective Communication in MPI: Part 2
Introduction to GPU Computing
A Dive into Software Stack and Nvidia Architecture
Comparative Analysis of NVIDIA and Intel GPU Architectures
Understanding FLOPS and Memory Bandwidth Calculations
SIMD vs. SIMT: Thread Mapping, Scheduling
Understanding 1D, 2D, and 3D Grid Arrangements Part 1
Understanding 1D, 2D, and 3D Grid Arrangements Part 2
Thread Block Mapping and Warp Scheduling in GPU
Exploring Warp Scheduling and Latency Management in NVIDIA GPUs
An Introduction to GPU Programming
2: An Introduction to GPU Programming
Understanding NVIDIA GPU Memory Types and Efficient Memory
4: Understanding NVIDIA GPU Memory Types and Efficient Memory
Understanding Third Divergence in Parallel Computing and Its
Memory Layouts and Their Role in Optimizing Computing
CUDA Program Compilation and Execution
2: CUDA Program Compilation and Execution
Introduction to OpenACC
Parallelization of loops using OpenACC
OpenACC Data Management
OpenACC Loop Optimizations
Implementing Asynchronous behavior in OpenACC
Programming for multiple-device architecture using OpenACC
Profiling and Parallelizing the serial code using OpenACC
Programming for multiple-device architecture using MPI and CUDA
Programming for multiple-device architecture using MPI
Profiling Serial codes using GNU gprof
Profiling and Debugging of the codes using Valgrind
Code Debugging using GDB
Performance Analysis of MPI codes
Parallel Debugging of MPI Programs using Open Source Tools
Role of Numerical Methods in High Performance Scientific
Libraries used in High Performance Scientific Computing
Introduction to HPC Schedulers using SLURM and PBS
Scientific Visualization
Revision and challenges in the future
OpenMP Revision
CUDA Revision
MPI Revision
OpenACC Revision
Heterogeneous Computing
Trends in Microprocessor Architectures