high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Changxin Ke, Rui Zhang, Zixiang Fang, Zhenghong Li, Yuanbo Wen, Jiashuo Shen, Shuo Wang, Jiaming Guo, Ling Li, Qi Guo, Yunji Chen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, Package, Triton

October 4, 2026 by hgpu

AI as a Compiler: Compiling Triton kernels without the Triton compiler

François Costa, Charly Castes, Thomas Bourgeat, Azalia Mirhoseini

View

Download (PDF)

Tags: Computer science, LLM, nVidia, nVidia B200, nVidia H100, nVidia L40s, PTX, Triton

October 4, 2026 by hgpu

AIM: Agentic Idea Management for Automated Research

Hyeong Kyu Choi, Bhavana Dalvi Mishra, Jiefeng Chen, Mihir Parmar, Rui Meng, Chun-Liang Li, Xiangru Tang, Sharon Li, Jinsung Yoon, Tomas Pfister

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia

October 4, 2026 by hgpu

KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization

Aheli Poddar, Sanskar Prasad, Arindam Samanta, Subha Chakraborty, Vishal Goyal, Rohit Singh Rathaur

View

Download (PDF)

Tags: Computer science, CUBLAS, CUDA, Deep learning, LLM, nVidia, nVidia H200, Triton

September 28, 2026 by hgpu

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Liam Cooper, Shinnung Jeong, Hyeran Jeon, Jeffrey Young, Hyesoon Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Hardware Architecture, LLM, nVidia, nVidia A100, nVidia H100, nVidia L40s, Package

September 28, 2026 by hgpu

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

Kartik Kothalkar

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia H100, Performance, ROCm

September 28, 2026 by hgpu

Xtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing

Zhuobin Huang, Kai Zhang, Weihao Cui, Hongshi Tan, Liang Luo, Christopher Dewan, Shen Li, Bingsheng He

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Computer science, LLM, nVidia, nVidia B300, nVidia H100, Performance

September 28, 2026 by hgpu

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

Li Chen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia GB10, Package, Performance

September 20, 2026 by hgpu

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

Mingyuan Ma, Hu He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Hardware Architecture, nVidia, Package, Programming Languages

September 20, 2026 by hgpu

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

Omkar Shewale, Deepak Kumar, Divakar Kumar Yadav

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Package, Performance

September 20, 2026 by hgpu

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

Tristan Chenaille, Francesca Cuteri, Raphaël Prat, Guillaume Latu, Thomas Helfer

View

Download (PDF)

Tags: Computer science, CUDA, Factorization, Linear Algebra, nVidia, nVidia H100

September 20, 2026 by hgpu

Stencil Computation at the Intersection of AI and HPC

Timothee Ewart, Mauricio Araya-Polo

View

Download (PDF)

Tags: AI, AMD, AMD Radeon Instinct MI325X, Computer science, HPC, Intel Arc B580, Intel B70, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, nVidia RTX PRO 6000, performance portability, Stencil computation, SYCL, Triton

September 14, 2026 by hgpu

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

Automatically Generating ML Compiler Backends from Tensor Accelerator ISA Descriptions

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

pytest-gpu-proof: Enabling Cloud-CPU Continuous Integration for GPU Code with Local GPU Attestation

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

EinsummableV3 - graph-based computation with tensor operations support

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

MaxKernel: Intelligent TPU Kernel Engineering Agents

MaxKernel: Agentic Kernel Generation for TPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

AI as a Compiler: Compiling Triton kernels without the Triton compiler

AIM: Agentic Idea Management for Automated Research

KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

Xtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

Stencil Computation at the Intersection of AI and HPC

Recent source codes

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

EinsummableV3 - graph-based computation with tensor operations support

MaxKernel: Intelligent TPU Kernel Engineering Agents

Most viewed papers (last 30 days)