high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Home-made Diffusion Model from Scratch to Hatch

Shih-Ying Yeh

View

Download (PDF)

Source codes

Tags: Computer science, Computer vision, nVidia, nVidia GeForce RTX 5090, Package, Python, PyTorch

September 14, 2025 by hgpu

High Performance Matrix Multiplication

Ethan Davis

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, nVidia, OpenMP, Package, Performance, Python, Tesla V100

September 14, 2025 by hgpu

Combining Performance and Productivity: Accelerating the Network Sensing Graph Challenge with GPUs and Commodity Data Science Software

Siddharth Samsi, Dan Campbell, Emanuel Scoullos, Oded Green

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, HPC, nVidia, nVidia A100, nVidia H100, nVidia H200, Sensing

September 14, 2025 by hgpu

CrossTL: A Universal Programming Language Translator with Unified Intermediate Representation

Nripesh Niketan, Vaatsalya Shrivastva

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, DirectX, GLSL, HIP, HLSL, nVidia, OpenGL, Package, Programming Languages, Vulkan

September 7, 2025 by hgpu

AnnotationGym: A Generic Framework for Automatic Source Code Annotation

Hafsah Shahzad, Ahmed Sanaullah, Sanjay Arora, Ulrich Drepper, Martin Herbordt

View

Download (PDF)

Tags: Benchmarking, Compilers, Computer science, FPGA, HLS, OpenACC, OpenMP

September 7, 2025 by hgpu

Harnessing Batched BLAS/LAPACK Kernels on GPUs for Parallel Solutions of Block Tridiagonal Systems

David Jin, Alexis Montoison, Sungho Shin

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, BLAS, Computer science, CUDA, Factorization, Julia, nVidia, nVidia H200, Package, ROCm

September 7, 2025 by hgpu

GPU-acceleration of the Discontinuous Galerkin Shallow Water Equations Solver (DG-SWEM) using CUDA and OpenACC

Chayanon Wichitrnithed, Eirik Valseth, Clint Dawson

View

Download (PDF)

Source codes

Tags: cfd, Computational Physics, CUDA, Data parallelism, Fluid dynamics, Fortran, MPI, nVidia, nVidia GH200, OpenACC, Package, Physics

September 7, 2025 by hgpu

Managing Multi Instance GPUs for High Throughput and Energy Savings

Abhijeet Saraha, Yuanbo Li, Chris Porter, Santosh Pande

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, LLM, nVidia, nVidia A100, PyTorch, Security

September 7, 2025 by hgpu

BePilot: An AI Programming Assistant for Compiler Backend Development

Ming Zhong, Xin Sun, Fang Lv, Lulin Wang, Hongna Geng, Lei Qiu, Huimin Cui, Xiaobing Feng

View

Download (PDF)

Tags: AI, Code generation, Compilers, Computer science, LLM, nVidia, nVidia A100, nVidia V100

August 31, 2025 by hgpu

Accelerating a Linear Programming Algorithm on AMD GPUs

Xiyan Hu, Titus Parker, Connor Phillips, Yifa Yu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, AMD Radeon Instinct MI325X, ATI, Computer science, HIP, nVidia, nVidia A100, Package, Performance, PyTorch, ROCm, Thesis

August 31, 2025 by hgpu

Scalable Engine and the Performance of Different LLM Models in a SLURM based HPC architecture

Anderson de Lima Luiz, Shubham Vijay Kurlekar, Munir Georges

View

Download (PDF)

Tags: Computer science, Heterogeneous systems, HPC, LLM, nVidia, nVidia A100

August 31, 2025 by hgpu

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Jacob Wahlgren, Gabin Schieffer, Ruimin Shi, Edgar A. León, Roger Pearce, Maya Gokhale, Ivy Peng

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI300A, ATI, Benchmarking, Computer science, HIP, Memory model, Package

August 31, 2025 by hgpu

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

Hunting CUDA Bugs at Scale with cuFuzz

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Home-made Diffusion Model from Scratch to Hatch

High Performance Matrix Multiplication

Combining Performance and Productivity: Accelerating the Network Sensing Graph Challenge with GPUs and Commodity Data Science Software

CrossTL: A Universal Programming Language Translator with Unified Intermediate Representation

AnnotationGym: A Generic Framework for Automatic Source Code Annotation

Harnessing Batched BLAS/LAPACK Kernels on GPUs for Parallel Solutions of Block Tridiagonal Systems

GPU-acceleration of the Discontinuous Galerkin Shallow Water Equations Solver (DG-SWEM) using CUDA and OpenACC

Managing Multi Instance GPUs for High Throughput and Energy Savings

BePilot: An AI Programming Assistant for Compiler Backend Development

Accelerating a Linear Programming Algorithm on AMD GPUs

Scalable Engine and the Performance of Different LLM Models in a SLURM based HPC architecture

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Recent source codes

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

Most viewed papers (last 30 days)