high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia H100

ATTUNE: Agentic Throughput Tuning for LLM Training

Leo Fan, Hongyang Wang, Wenbo Chen, Jingguo Liu, Xian Li, Xuan Wang, Ruochen Wen, Yiming Yan, Hao Wu, Zheshen Wang, Benoit Dumoulin

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia B200, nVidia H100, nVidia H200, Package

October 19, 2026 by hgpu

AgentGarten: Code Worlds for Evolving Agents

Jiawei Chi, Shangchen Miao, Zhiyuan Shi, Kailu Wu, Hanyang Wang, Weiliang Chen, Qiyu Dai, Chengyang Li, Jinshan Ren, Jun Gao, Mingsheng Long, Yueqi Duan, Jiangran Lyu, Jialong Wu, Fangfu Liu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Package, Triton

October 14, 2026 by hgpu

AI as a Compiler: Compiling Triton kernels without the Triton compiler

François Costa, Charly Castes, Thomas Bourgeat, Azalia Mirhoseini

View

Download (PDF)

Tags: Computer science, LLM, nVidia, nVidia B200, nVidia H100, nVidia L40s, PTX, Triton

October 4, 2026 by hgpu

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Liam Cooper, Shinnung Jeong, Hyeran Jeon, Jeffrey Young, Hyesoon Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Hardware Architecture, LLM, nVidia, nVidia A100, nVidia H100, nVidia L40s, Package

September 28, 2026 by hgpu

Xtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing

Zhuobin Huang, Kai Zhang, Weihao Cui, Hongshi Tan, Liang Luo, Christopher Dewan, Shen Li, Bingsheng He

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Computer science, LLM, nVidia, nVidia B300, nVidia H100, Performance

September 28, 2026 by hgpu

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

Kartik Kothalkar

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia H100, Performance, ROCm

September 28, 2026 by hgpu

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

Omkar Shewale, Deepak Kumar, Divakar Kumar Yadav

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Package, Performance

September 20, 2026 by hgpu

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

Tristan Chenaille, Francesca Cuteri, Raphaël Prat, Guillaume Latu, Thomas Helfer

View

Download (PDF)

Tags: Computer science, CUDA, Factorization, Linear Algebra, nVidia, nVidia H100

September 20, 2026 by hgpu

Stencil Computation at the Intersection of AI and HPC

Timothee Ewart, Mauricio Araya-Polo

View

Download (PDF)

Tags: AI, AMD, AMD Radeon Instinct MI325X, Computer science, HPC, Intel Arc B580, Intel B70, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, nVidia RTX PRO 6000, performance portability, Stencil computation, SYCL, Triton

September 14, 2026 by hgpu

Taming Bitwise Behavior in GPU Kernels with Tensor Core: Black-Box Reconstruction, Compiler Enforcement, and Static Verification

Ziteng Yang, Nicholas J. Riasanovsky, Warren Deng, Vivek Sarkar

View

Download (PDF)

Tags: Computer science, CUBLAS, CUDA, nVidia, nVidia GB300, nVidia H100, PTX, Triton

September 14, 2026 by hgpu

Concurrency Response of Plain Global Loads on the NVIDIA H100

Somashekar Manjunath, Rahul Ramachandra M

View

Download (PDF)

Tags: Computer science, CUDA, Hardware Architecture, nVidia, nVidia H100, Performance

August 30, 2026 by hgpu

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

Genghan Zhang, Yixin Dong, Chengze Fan, Zhichen Zeng, Yueming Yuan, Shaowei Zhu, Kunle Olukotun

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, LLM, nVidia, nVidia B200, nVidia H100, Package, PTX

August 30, 2026 by hgpu

TattvaSwarm: a sovereign personal AI swarm

Subgrid-Scale Turbulence Closure and 44.01× Speedup on Blackwell SM120: Matrix-Free Fused Triton Kernels for High-Resolution Global Climate Modeling

HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes

Qwen3-235B @ 1M tokens on AMD MI355X

CHUNDER: Enabling Million-Token Qwen3 Serving on AMD ROCm

CUDA++ for the NVIDIA DGX Spark

Reverse Engineering the CUDA Software Stack: A Clean-Room GPU Machine-Code Toolchain for the NVIDIA GB10

ATTUNE: Agentic Throughput Tuning for LLM Training

HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills

Brian2 Atlas

A Unified Intermediate Representation and Execution Architecture for Heterogeneous and Distributed Neural Simulation

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelLens: Deploying Triton Kernels to C++ Inference Engines

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

ATTUNE: Agentic Throughput Tuning for LLM Training

AgentGarten: Code Worlds for Evolving Agents

AI as a Compiler: Compiling Triton kernels without the Triton compiler

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Xtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

Stencil Computation at the Intersection of AI and HPC

Taming Bitwise Behavior in GPU Kernels with Tensor Core: Black-Box Reconstruction, Compiler Enforcement, and Static Verification

Concurrency Response of Plain Global Loads on the NVIDIA H100

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

Recent source codes

TattvaSwarm: a sovereign personal AI swarm

HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes

Qwen3-235B @ 1M tokens on AMD MI355X

CUDA++ for the NVIDIA DGX Spark

ATTUNE: Agentic Throughput Tuning for LLM Training

HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills

Brian2 Atlas

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Most viewed papers (last 30 days)