high performance computing on graphics processing units: hgpu.org

Weinan Dai, Hanlin Wu, Qiying Yu, Huan-ang Gao, Jiahao Li, Chengquan Jiang, Weiqiang Lou, Yufan Song, Hongli Yu, Jiaze Chen, Wei-Ying Ma, Ya-Qin Zhang, Jingjing Liu, Mingxuan Wang, Xin Liu, Hao Zhou

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Deep learning, nVidia, nVidia H20, Package

March 4, 2026 by hgpu

HetCCL: Accelerating LLM Training with Heterogeneous GPUs

Heehoon Kim, Jaehwan Lee, Taejeoung Kim, Jongwon Park, Jinpyo Kim, Pyongwon Suh, Ryan H. Choi, Sangwoo Lee, Jaejin Lee

View

Download (PDF)

Tags: AMD, AMD FirePro W7800, Computer science, Deep learning, GPU cluster, Heterogeneous systems, LLM, nVidia, Tesla V100

February 8, 2026 by hgpu

Equivalence Checking of ML GPU Kernels

Kshitij Dubey, Benjamin Driscoll, Anjiang Wei, Neeraj Kayal, Rahul Sharma, Alex Aiken

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, LLM, Machine learning, Matrix multiplication, nVidia, PTX

January 12, 2026 by hgpu

Hardware Acceleration for Neural Networks: A Comprehensive Survey

Bin Xu, Ayan Banerjee, Sandeep Gupta

View

Download (PDF)

Tags: Benchmarking, Cloud, Computer science, Deep learning, FPGA, Neural networks, Review, Security, survey, TPU

January 4, 2026 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

KernelLens: Deploying Triton Kernels to C++ Inference Engines

Introduction to Computer Vision

KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization

Analyzing the Impact of Kernel Fusion on GPU Tensor Operation Performance: A Systematic Performance Study

CuBridge: An LLM-Based Framework for Understanding and Reconstructing High-Performance Attention Kernels

FACT: Compositional Kernel Synthesis with a Three-Stage Agentic Workflow

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation

HetCCL: Accelerating LLM Training with Heterogeneous GPUs

Equivalence Checking of ML GPU Kernels

Recent source codes

Brian2 Atlas

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

Most viewed papers (last 30 days)