high performance computing on graphics processing units: hgpu.org

Zhu Zhu, Yu Sun, Dhatri Parakal, Bo Fang, Steven Farrell, Gregory H. Bauer, Brett Bode, Ian T. Foster, Michael E. Papka, William Gropp, Zhao Zhang, Lishan Yang

View

Download (PDF)

Tags: Computer science, HPC, Memory, nVidia, nVidia A100, nVidia A40

August 10, 2025 by hgpu

ConTraPh: Contrastive Learning for Parallelization and Performance Optimization

Quazi Ishtiaque Mahmud, Ali TehraniJamsaz, Nesreen K. Ahmed, Theodore L. Willke, Ali Jannesari

View

Download (PDF)

Tags: Code generation, Computer science, Heterogeneous systems, HPC, LLM, nVidia, OpenACC, OpenCL, OpenMP, Tesla V100

August 10, 2025 by hgpu

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

Antonio De Caro, Gennaro Cordasco, Federico Ficarelli, Biagio Cosenza

View

Download (PDF)

Source codes

Tags: Biology, Chemistry, Computer science, CUDA, MPI, nVidia, nVidia V100, oneAPI, Package

August 10, 2025 by hgpu

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Daichi Mukunoki

View

Download (PDF)

Source codes

Tags: Computer science, Matrix multiplication, nVidia, nVidia GeForce RTX 5060 Ti, Package, Performance

August 10, 2025 by hgpu

NPUEval: Optimizing NPU Kernels with LLMs and Open Source Compilers

Sarunas Kalade, Graham Schelle

View

Download (PDF)

Tags: Code generation, Computer science, Machine learning, Programming Languages

August 3, 2025 by hgpu

CUDAnalyst (CUDA + Analyst)

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

CodegenBench

CodegenBench: Can LLMs Write Efficient Code Across Architectures?

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

Performant Unified GPU Kernels for Portable Singular Value Computation Across Hardware and Precision

AGFT: An Adaptive GPU Frequency Tuner for Real-Time LLM Inference Optimization

Understanding the Landscape of Ampere GPU Memory Errors

ConTraPh: Contrastive Learning for Parallelization and Performance Optimization

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

NPUEval: Optimizing NPU Kernels with LLMs and Open Source Compilers

Recent source codes

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Device Virtual Machine (DVM)

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

Most viewed papers (last 30 days)