high performance computing on graphics processing units: hgpu.org

hgpu.org » PyTorch

MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU

Kun Cheng, Songshuo Lu, Sicong Liao, Tankun Li, Yafei Zhang, Dong Yang, Qiheng Lv, Hua Wang, Zhi Chen, Yaohua Tang

View

Download (PDF)

Tags: Computer science, CUDA, LLM, PyTorch

June 8, 2026 by hgpu

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Qitong Sun, Jun Han, Tianlin Li, Zhe Tang, Sheng Chen, Fei Yang, Aishan Liu, Xianglong Liu, Yang Liu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Performance, PyTorch

March 15, 2026 by hgpu

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

Jinwu Chen, Qidie Wu, Bin Li, Lin Ma, Xin Si, Yang Hu, Shouyi Yin, Jun Yang

View

Download (PDF)

Source codes

Tags: AI, Code generation, Computer science, CUDA, nVidia, nVidia A100, Package, PyTorch

December 21, 2025 by hgpu

PystachIO: Efficient Distributed GPU Query Processing with PyTorch over Fast Networks & Fast Storage

Jigao Luo, Nils Boeschen, Muhammad El-Hindi, Carsten Binnig

View

Download (PDF)

Tags: Computer science, CUDA, Databases, GPU cluster, nVidia, nVidia A100, nVidia DGX-1, PyTorch

December 21, 2025 by hgpu

Accelerating Molecular Simulations with Triton: Fused GPU Kernels for TensorNet Neural Potentials

Manpreet Singh

View

Download (PDF)

Tags: Biology, Chemistry, CUDA, Molecular dynamics, nVidia, nVidia A100, PyTorch, Triton

December 15, 2025 by hgpu

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

Haonan Li, Keyu Man, Partha Kanuparthy, Hanning Chen, Wei Sun, Sreen Tallam, Chenguang Zhu, Kevin Zhu, Zhiyun Qian

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, Machine learning, nVidia, nVidia H100, Package, PyTorch, Triton

December 15, 2025 by hgpu

Decoupled Triton: A Block-Level Decoupled Language for Writing and Exploring Efficient Machine-Learning Kernels

Quinn Leo Pham

View

Download (PDF)

Tags: Compilers, Computer science, Machine learning, nVidia, nVidia RTX 5000 Ada, PyTorch, Thesis, Triton

December 7, 2025 by hgpu

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

Marcin Spoczynski, Marcela S. Melara

View

Download (PDF)

Source codes

Tags: Computer science, Machine learning, nVidia, oneAPI, Package, PyTorch, Rust, Security, SYCL

November 2, 2025 by hgpu

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

Zhongzhen Wen, Hongyu Liu, Tingwei Zhu, Minxue Pan, Shaohua Wang, Yuanyi Lin, Kairui Liu, Tian Zhang, Xuandong Li

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, Package, PyTorch

November 2, 2025 by hgpu

EvoEngineer: Mastering Automated CUDA Kernel Code Evolution with Large Language Models

Ping Guo, Chenyu Zhu, Siyuan Chen, Fei Liu, Xi Lin, Zhichao Lu, Qingfu Zhang

View

Download (PDF)

Tags: AI, Code generation, Computer science, CUDA, Deep learning, LLM, nVidia, nVidia GeForce RTX 4090, nVidia H100, PyTorch

October 12, 2025 by hgpu

Home-made Diffusion Model from Scratch to Hatch

Shih-Ying Yeh

View

Download (PDF)

Source codes

Tags: Computer science, Computer vision, nVidia, nVidia GeForce RTX 5090, Package, Python, PyTorch

September 14, 2025 by hgpu

Managing Multi Instance GPUs for High Throughput and Energy Savings

Abhijeet Saraha, Yuanbo Li, Chris Porter, Santosh Pande

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, LLM, nVidia, nVidia A100, PyTorch, Security

September 7, 2025 by hgpu

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

Analyzing the Impact of Kernel Fusion on GPU Tensor Operation Performance: A Systematic Performance Study

IntelliKit: Agent-first tooling for AMD hardware

Kerncap: Automated Kernel Extraction and Isolation for AMD GPUs

DITRON: Distributed Compiler based on Triton for Parallel Systems

DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Agentic Code Optimization via Compiler-LLM Cooperation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

PystachIO: Efficient Distributed GPU Query Processing with PyTorch over Fast Networks & Fast Storage

Accelerating Molecular Simulations with Triton: Fused GPU Kernels for TensorNet Neural Potentials

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

Decoupled Triton: A Block-Level Decoupled Language for Writing and Exploring Efficient Machine-Learning Kernels

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

EvoEngineer: Mastering Automated CUDA Kernel Code Evolution with Large Language Models

Home-made Diffusion Model from Scratch to Hatch

Managing Multi Instance GPUs for High Throughput and Energy Savings

Recent source codes

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

Probe-and-Refine Tuning of Repository Guidance for AI Coding Agents

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Agentic Code Optimization via Compiler-LLM Cooperation

Most viewed papers (last 30 days)