high performance computing on graphics processing units: hgpu.org

hgpu.org » MPI

Exploring GPU-to-GPU Communication: Insights into Supercomputer Interconnects

Daniele De Sensi, Lorenzo Pichetti, Flavio Vella, Tiziano De Matteis, Zebin Ren, Luigi Fusco, Matteo Turisini, Daniele Cesarini, Kurt Lust, Animesh Trivedi, Duncan Roweth, Filippo Spiga, Salvatore Di Girolamo, Torsten Hoefler

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, Benchmarking, Computer science, CUDA, HPC, MPI, nVidia, nVidia A100, nVidia H100, Performance

September 1, 2024 by hgpu

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, nVidia DGX-A100, Python

June 30, 2024 by hgpu

Understanding GPU Triggering APIs for MPI+X Communication

Patrick G. Bridges, Anthony Skjellum, Evan D. Suggs, Derek Schafer, Purushotham V. Bangalore

View

Download (PDF)

Tags: Computer science, HPC, MPI, Performance

June 16, 2024 by hgpu

Speed, power and cost implications for GPU acceleration of Computational Fluid Dynamics on HPC systems

Zachary Cooper-Baldock, Brenda Vara Almirall, Kiao Inthavong

View

Download (PDF)

Tags: cfd, Fluid dynamics, HPC, MPI, nVidia, nVidia A100, nVidia V100, Performance

April 7, 2024 by hgpu

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality

Adrian Perez Dieguez, Min Choi, Mahmut Okyay, Mauro Del Ben, Bryan M. Wong, Khaled Z. Ibrahim

View

Download (PDF)

Tags: Computer science, CUDA, HPC, MPI, nVidia, nVidia A100, OpenMP, Performance

March 18, 2024 by hgpu

An Evaluative Comparison of Performance Portability across GPU Programming Models

Joshua H. Davis, Pranav Sivaraman, Isaac Minn, Konstantinos Parasyris, Harshitha Menon, Giorgis Georgakoudis, Abhinav Bhatele

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, AMD Radeon Instinct Mi50, ATI, Computer science, CUDA, Heterogeneous systems, HIP, MPI, nVidia, nVidia V100, OpenACC, OpenMP, Performance, performance portability, SYCL

February 18, 2024 by hgpu

Evaluating the Wide Area Classroom After 24,000 HPC Students

John Urbanic, Thomas Maiden, Valerie Rossi

View

Download (PDF)

Tags: Education, HPC, Machine learning, MPI, OpenACC, OpenMP, Physics

February 12, 2024 by hgpu

RDMA-Based Algorithms for Sparse Matrix Multiplication on GPUs

Benjamin Brock, Aydın Buluç, Katherine Yelick

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, MPI, nVidia, nVidia DGX-2, Sparse matrix, Tesla V100

December 3, 2023 by hgpu

ExaNBody: a HPC framework for N-Body applications

Thierry Carrard, Raphaël Prat, Guillaume Latu, Killian Babilotte, Paul Lafourcade, Lhassan Amarsid, Laurent Soulard

View

Download (PDF)

Tags: Astrophysics, Computer science, CUDA, MPI, N-body simulation, nVidia, nVidia A100, OpenMP, performance portability

November 19, 2023 by hgpu

Fortran performance optimisation and auto-parallelisation by leveraging MLIR-based domain specific abstractions in Flang

Nick Brown, Maurice Jamieson, Anton Lydike, Emilien Bauer, Tobias Grosser

View

Download (PDF)

Source codes

Tags: Computer science, Fortran, HPC, LLVM, MPI, nVidia, Package, Performance, Tesla V100

October 8, 2023 by hgpu

Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

Xinzhe Wu, Edoardo Di Napoli

View

Download (PDF)

Source codes

Tags: Algorithm optimization, Computer science, CUDA, MPI, nVidia, nVidia A100, OpenMP, OpenMPI, Package

October 8, 2023 by hgpu

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

Arpan Jain

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, Data parallelism, Deep learning, HPC, Machine learning, MPI, Neural networks, nVidia, Speech recognition, Tesla K80, Tesla V100, Thesis

October 1, 2023 by hgpu

high performance computing on graphics processing units: hgpu.org

Exploring GPU-to-GPU Communication: Insights into Supercomputer Interconnects

Composing Distributed Computations Through Task and Kernel Fusion

Understanding GPU Triggering APIs for MPI+X Communication

Speed, power and cost implications for GPU acceleration of Computational Fluid Dynamics on HPC systems

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality

An Evaluative Comparison of Performance Portability across GPU Programming Models

Evaluating the Wide Area Classroom After 24,000 HPC Students

RDMA-Based Algorithms for Sparse Matrix Multiplication on GPUs

ExaNBody: a HPC framework for N-Body applications

Fortran performance optimisation and auto-parallelisation by leveraging MLIR-based domain specific abstractions in Flang

Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)