high performance computing on graphics processing units: hgpu.org

David van Balen, Tiziano De Matteis, Clemens Grelck, Troels Henriksen, Aaron W. Hsu, Gabriele K. Keller, Thomas Koopman, Trevor L. McDonell, Cosmin Oancea, Sven-Bodo Scholz, Artjoms Sinkarovs, Tom Smeding, Phil Trinder, Ivo Gabe de Wolff, Alexandros Nikolaos Ziogas

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, HIP, N-body simulation, nVidia, nVidia A30, OpenCL, Package, Performance, performance portability, Programming Languages

May 18, 2025 by hgpu

GPU Performance Portability needs Autotuning

Burkhard Ringlein, Thomas Parnell, Radu Stoica

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, ATI, Auto-Tuning, Computer science, CUDA, DSL, HIP, LLM, nVidia, nVidia A100, Performance, performance portability

May 18, 2025 by hgpu

Dynamic Memory Management on GPUs with SYCL

Russell K. Standish

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HIP, Memory model, nVidia, Package, Performance, SYCL

May 4, 2025 by hgpu

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Aashaka Shah, Abhinav Jangda, Binyang Li, Caio Rocha, Changho Hwang, Jithin Jose, Madan Musuvathi, Olli Saarikivi, Peng Cheng, Qinghua Zhou, Roshan Dathathri, Saeed Maleki, Ziyue Yang

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI300X, ATI, Computer science, CUDA, Heterogeneous systems, HIP, nVidia, nVidia A100, nVidia H100, Package

April 27, 2025 by hgpu

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

Michele Martone, Julia Lawall

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HIP, HPC, nVidia, OpenMP, Package, Programming Languages

March 30, 2025 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Accelerating a Linear Programming Algorithm on AMD GPUs

Inter-APU Communication on AMD MI300A Systems via Infinity Fabric: a Deep Dive

Performant Unified GPU Kernels for Portable Singular Value Computation Across Hardware and Precision

Performance Portable Gradient Computations Using Source Transformation

Specx: a C++ task-based runtime system for heterogeneous distributed architectures

CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark

Comparing Parallel Functional Array Languages: Programming and Performance

GPU Performance Portability needs Autotuning

Dynamic Memory Management on GPUs with SYCL

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)