high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

CUDABeaver: Benchmarking LLM-Based Automated CUDA Debugging

Shiyang Li, Haoyang Chen, Mattia Fazzini, Caiwen Ding

View

Tags: Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia H200, nVidia RTX PRO 6000

May 20, 2026 by hgpu

CuBridge: An LLM-Based Framework for Understanding and Reconstructing High-Performance Attention Kernels

Xing Ma, Yangjie Zhou, Wu Sun, Zihan Liu, Jingwen Leng, Yun Lin, Shixuan Sun, Minyi Guo, Jin Song Dong

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, LLM, nVidia, nVidia A100, nVidia H100

May 11, 2026 by hgpu

FACT: Compositional Kernel Synthesis with a Three-Stage Agentic Workflow

Sina Heidari, Dimitrios S. Nikolopoulos

View

Download (PDF)

Tags: Computer science, CUBLAS, CUDA, Deep learning, nVidia, nVidia A100

May 3, 2026 by hgpu

MobileKernelBench: Can LLMs Write Efficient Kernels for Mobile Devices?

Xingze Zou, Jing Wang, Yuhua Zheng, Xueyi Chen, Haolei Bai, Lingcheng Kong, Syed A.R. Abu-Bakar, Zhaode Wang, Chengfei Lv, Haoji Hu, Huan Wang

View

Download (PDF)

Tags: Benchmarking, Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100

March 22, 2026 by hgpu

An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU

Ruijia Yang, Zeyi Wen

View

Download (PDF)

Tags: AMD, AMD Radeon RX 7900 XT, Computer science, Heterogeneous systems, nVidia, nVidia A100, nVidia GeForce RTX 4090, Triton

March 18, 2026 by hgpu

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Qitong Sun, Jun Han, Tianlin Li, Zhe Tang, Sheng Chen, Fei Yang, Aishan Liu, Xianglong Liu, Yang Liu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Performance, PyTorch

March 15, 2026 by hgpu

CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

Xiao Zhu, Xinyu Zhou, Boyu Zhu, Hanxu Hu, Mingzhe Du, Haotian Zhang, Huiming Wang, Zhijiang Guo

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, LLM, nVidia, nVidia A100, Package

March 1, 2026 by hgpu

KernelBlaster: Continual Cross-Task CUDA Optimization via Memory-Augmented In-Context Reinforcement Learning

Kris Shengjun Dong, Sahil Modi, Dima Nikiforov, Sana Damani, Edward Lin, Siva Kumar Sastry Hari, Christos Kozyrakis

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, nVidia H100, nVidia L40s, nVidia RTX A6000, Performance

February 23, 2026 by hgpu

OptiML: An End-to-End Framework for Program Synthesis and CUDA Kernel Optimization

Arijit Bhattacharjee, Heng Ping, Son Vu Le, Paul Bogdan, Nesreen K. Ahmed, Ali Jannesari

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Performance

February 23, 2026 by hgpu

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

Haolei Bai, Lingcheng Kong, Xueyi Chen, Jianmian Wang, Zhiqiang Tao, Huan Wang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Package

February 16, 2026 by hgpu

Deep Kernel Fusion for Transformers

Zixi Zhang, Zhiwen Mo, Yiren Zhao, Robert Mullins

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Performance

February 16, 2026 by hgpu

Scaling GPU-to-CPU Migration for Efficient Distributed Execution on CPU Clusters

Ruobing Han, Hyesoon Kim

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, nVidia V100, Triton

February 8, 2026 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

CUDABeaver: Benchmarking LLM-Based Automated CUDA Debugging

CuBridge: An LLM-Based Framework for Understanding and Reconstructing High-Performance Attention Kernels

FACT: Compositional Kernel Synthesis with a Three-Stage Agentic Workflow

MobileKernelBench: Can LLMs Write Efficient Kernels for Mobile Devices?

An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

KernelBlaster: Continual Cross-Task CUDA Optimization via Memory-Augmented In-Context Reinforcement Learning

OptiML: An End-to-End Framework for Program Synthesis and CUDA Kernel Optimization

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

Deep Kernel Fusion for Transformers

Scaling GPU-to-CPU Migration for Efficient Distributed Execution on CPU Clusters

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

Most viewed papers (last 30 days)