high performance computing on graphics processing units: hgpu.org

Yunjae Lee, Juntaek Lim, Jehyeon Bang, Eunyeong Cho, Huijong Jeong, Taesu Kim, Hyungjun Kim, Joonhyung Lee, Jinseop Im, Ranggi Hwang, Se Jung Kwon, Dongsoo Lee, Minsoo Rhu

View

Download (PDF)

Tags: AI, Benchmarking, Computer science, CUDA, Intel, Intel Gaudi-2, nVidia, nVidia A100, Performance

January 6, 2025 by hgpu

Performant Automatic BLAS Offloading on Unified Memory Architecture with OpenMP First-Touch Style Data Movement

Junjie Li

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Linear Algebra, nVidia, nVidia GH200, OpenMPI, Physics, Quantum Physics

January 6, 2025 by hgpu

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

Avinash Maurya

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, HPC, nVidia, nVidia DGX-A100, Package, Thesis

December 29, 2024 by hgpu

Asynchronous-Many-Task Systems: Challenges and Opportunities – Scaling an AMR Astrophysics Code on Exascale machines using Kokkos and HPX

Gregor Daiß, Patrick Diehl, Jiakun Yan, John K. Holmen, Rahulkumar Gayatri, Christoph Junghans, Alexander Straub, Jeff R. Hammond, Dominic Marcello, Miwako Tsuji, Dirk Pflüger, Hartmut Kaiser

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, Astrophysics, ATI, Computer science, CUDA, Heterogeneous systems, HIP, HPC, nVidia, nVidia A100, Package, performance portability, Physics

December 29, 2024 by hgpu

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

A comparison of HPC-based quantum computing simulators using Quantum Volume

Debunking the CUDA Myth Towards GPU-based AI Systems

Performant Automatic BLAS Offloading on Unified Memory Architecture with OpenMP First-Touch Style Data Movement

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

Asynchronous-Many-Task Systems: Challenges and Opportunities – Scaling an AMR Astrophysics Code on Exascale machines using Kokkos and HPX

Recent source codes

OpScanner

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

INT v.s. FP: A framework to compare low-bit integer and float-point formats

AutoDock-GPU: AutoDock for GPUs and other accelerators

NCCLX: collective communication framework

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Most viewed papers (last 30 days)