high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

HPC++: An LLVM-Based Automatic Parallelization Framework with Heterogeneous CPU–GPU Execution

Vahram Martirosyan

View

Download (PDF)

Tags: Computer science, HPC, LLVM, OpenCL

February 23, 2026 by hgpu

OptiML: An End-to-End Framework for Program Synthesis and CUDA Kernel Optimization

Arijit Bhattacharjee, Heng Ping, Son Vu Le, Paul Bogdan, Nesreen K. Ahmed, Ali Jannesari

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Performance

February 23, 2026 by hgpu

Improving HPC Code Generation Capability of LLMs via Online Reinforcement Learning with Real-Machine Benchmark Rewards

Ryo Mikasa, Shun-ichiro Hayashi, Daichi Mukunoki, Tetsuya Hoshino, Takahiro Katagiri

View

Download (PDF)

Tags: Benchmarking, Code generation, Computer science, CUDA, HPC, LLM, Matrix multiplication, nVidia, nVidia H100, OpenMP, Performance

February 16, 2026 by hgpu

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

Haolei Bai, Lingcheng Kong, Xueyi Chen, Jianmian Wang, Zhiqiang Tao, Huan Wang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Package

February 16, 2026 by hgpu

Deep Kernel Fusion for Transformers

Zixi Zhang, Zhiwen Mo, Yiren Zhao, Robert Mullins

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Performance

February 16, 2026 by hgpu

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

Wei Liu, Jiawei Xu, Yingru Li, Longtao Zheng, Tianjian Li, Qian Liu, Junxian He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Package, Triton

February 8, 2026 by hgpu

Scaling GPU-to-CPU Migration for Efficient Distributed Execution on CPU Clusters

Ruobing Han, Hyesoon Kim

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, nVidia V100, Triton

February 8, 2026 by hgpu

Inside VOLT: Designing an Open-Source GPU Compiler (Tool)

Shinnung Jeong, Chihyo Ahn, Huanzhi Pu, Jisheng Zhao, Hyesoon Kim, Blaise Pascal Tine

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, FPGA, nVidia, OpenCL, Package

February 8, 2026 by hgpu

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs

Jonathan Knoop, Hendrik Holtmann

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 5060 Ti, nVidia GeForce RTX 5070 Ti, nVidia GeForce RTX 5090, Package

February 2, 2026 by hgpu

ProfInfer: An eBPF-based Fine-Grained LLM Inference Profiler

Bohua Zou, Debayan Roy, Dhimankumar Yogesh Airao, Weihao Xu, Binqi Sun, Yutao Liu, Haibo Chen

View

Download (PDF)

Tags: Computer science, LLM, OpenCL, Performance

February 2, 2026 by hgpu

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)

Bastian Hagedorn, Alexander Collins, Tony Mongkolsmai, Vinod Grover

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia B200, Package, Performance, Profiling, Python, Triton

February 2, 2026 by hgpu

SynPerf: A Hybrid Analytical-ML Framework for GPU Performance Prediction

Kaixuan Zhang, Yunfan Cui, Shuhao Zhang, Chutong Ding, Shiyou Qian, Luping Wang, Jian Cao, Guangtao Xue, Cheng Huang, Guodong Yang, Liping Zhang

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, nVidia, nVidia A100, nVidia A40, nVidia H100, nVidia H20, nVidia H200, nVidia H800, nVidia L20, nVidia L40, nVidia RTX 6000 Ada, Performance, Triton

January 25, 2026 by hgpu

True 4-Bit Quantized CNN Training on CPU

True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

Hunting CUDA Bugs at Scale with cuFuzz

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

CONCUR: Benchmarking LLMs for Concurrent Code Generation

HIPRT: Ray Tracing using HIP

Ray Tracing using HIP

MXFP4 Training Support Codebase

Practical FP4 Training for Large-Scale MoE Models on Hopper GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

HPC++: An LLVM-Based Automatic Parallelization Framework with Heterogeneous CPU–GPU Execution

OptiML: An End-to-End Framework for Program Synthesis and CUDA Kernel Optimization

Improving HPC Code Generation Capability of LLMs via Online Reinforcement Learning with Real-Machine Benchmark Rewards

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

Deep Kernel Fusion for Transformers

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

Scaling GPU-to-CPU Migration for Efficient Distributed Execution on CPU Clusters

Inside VOLT: Designing an Open-Source GPU Compiler (Tool)

ProfInfer: An eBPF-based Fine-Grained LLM Inference Profiler

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)

SynPerf: A Hybrid Analytical-ML Framework for GPU Performance Prediction

Recent source codes

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

HIPRT: Ray Tracing using HIP

MXFP4 Training Support Codebase

Most viewed papers (last 30 days)