high performance computing on graphics processing units: hgpu.org

hgpu.org » CUDA

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, Jeff Hammond, Torsten Hoefler

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Network communication, nVidia, nVidia GH200

July 13, 2025 by hgpu

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Joshua Bakita, James H. Anderson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, nVidia RTX 6000 Ada, Package, Task scheduling

July 13, 2025 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

Aske N. Raahauge, Martin B. Marchioro, Marc I. Løvenskjold

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Extended precision, Futhark, nVidia, nVidia A100, Package, Thesis

July 6, 2025 by hgpu

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Joshua H. Davis, Daniel Nichols, Ishan Khillan, Abhinav Bhatele

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, OpenMP, Package

July 6, 2025 by hgpu

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

Jinliang Shi, Shigang Li, Youxuan Xu, Xueying Wang, Rongtian Fu, Zhi Ma, Tong Wu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce RTX 4090, nVidia H100, Package, Sparse matrix

July 6, 2025 by hgpu

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

Weiyi Xia, Maxim Moraru, Ying Wai Li, Timothy Liao, James R. Chelikowsky, Cai-Zhuang Wang

View

Download (PDF)

Source codes

Tags: Anisotropy, Computational Physics, Condensed matter, CUDA, Machine learning, Materials Science, Neural networks, nVidia, nVidia A100, Package, Physics

July 6, 2025 by hgpu

GCStack+GCScaler: Fast and Accurate GPU Performance Analyses Using Fine-Grained Stall Cycle Accounting and Interval Analysis

Hanna Cha, Sungchul Lee, Jounghoo Lee, Yeonan Ha, Joonsung Kim, Youngsok Kim

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Design space exploration, nVidia, nVidia GeForce RTX 3070, Performance

June 29, 2025 by hgpu

A Novel Compiler Transformation for Fast Sparse Matrix Multiplication in GPUs

Hossein Albakri, Kazem Cheshmi

View

Download (PDF)

Tags: Compilers, Computer science, CUBLAS, CUDA, Machine learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, Programming Languages, Sparse matrix

June 22, 2025 by hgpu

Engineering Supercomputing Platforms for Biomolecular Applications

Robert Welch, Charles Laughton, Oliver Henrich, Tom Burnley, Daniel Cole, Alan Real, Sarah Harris, James Gebbie-Rayet

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, AMD Radeon Instinct MI300X, ATI, Benchmarking, Biology, Biomolecules, Computational biology, CUDA, HPC, Molecular dynamics, nVidia, nVidia A100, nVidia GH200, nVidia H100, Package, Physics, ROCm, Tesla V100

June 22, 2025 by hgpu

CUDA-LLM: LLMs Can Write Efficient CUDA Kernels

Wentao Chen, Jiace Zhu, Qi Fan, Yehan Ma, An Zou

View

Download (PDF)

Tags: Artificial intelligence, Code generation, Computer sceince, CUDA, LLM, nVidia, nVidia GeForce GTX 1660, nVidia GeForce RTX 3090 Ti

June 15, 2025 by hgpu

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

Jiaqi Lv, Xufeng He, Yanchen Liu, Xu Dai, Yang Hu, Shouyi Yin

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Compilers, Computer science, CUDA, Deep learning, LLM, nVidia, nVidia A100, Package, performance portability

June 15, 2025 by hgpu

GPU Acceleration of SQL Analytics on Compressed Data

Zezhou Huang, Krystian Sakowski, Hans Lehnert, Wei Cui, Carlo Curino, Matteo Interlandi, Marius Dumitru, Rathijit Sen

View

Download (PDF)

Tags: Compression, Computer science, CUDA, Databases, Heterogeneous systems, nVidia, nVidia A100

June 15, 2025 by hgpu

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

BioAgent Bench: An AI Agent Evaluation Suite for Bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)

Awesome LLM-Driven Kernel Generation

Towards Automated Kernel Generation in the Era of LLMs

PhysProver: Advancing Automatic Theorem Proving for Physics

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Tilus: A Tile-Level GPGPU Programming Language for Low-Precision Computation

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

GCStack+GCScaler: Fast and Accurate GPU Performance Analyses Using Fine-Grained Stall Cycle Accounting and Interval Analysis

A Novel Compiler Transformation for Fast Sparse Matrix Multiplication in GPUs

Engineering Supercomputing Platforms for Biomolecular Applications

CUDA-LLM: LLMs Can Write Efficient CUDA Kernels

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

GPU Acceleration of SQL Analytics on Compressed Data

Recent source codes

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Awesome LLM-Driven Kernel Generation

PhysProver: Advancing Automatic Theorem Proving for Physics

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

Most viewed papers (last 30 days)