high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

Kartik Kothalkar

View

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia H100, Performance, ROCm

September 28, 2026 by hgpu

Xtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing

Zhuobin Huang, Kai Zhang, Weihao Cui, Hongshi Tan, Liang Luo, Christopher Dewan, Shen Li, Bingsheng He

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Computer science, LLM, nVidia, nVidia B300, nVidia H100, Performance

September 28, 2026 by hgpu

DeepSeek-V4-Flash on AMD gfx90a: Correctness Recovery and Inference Performance Engineering

Siming Huang

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI250, Computer science, HIP, LLM, Performance

September 20, 2026 by hgpu

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

Li Chen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia GB10, Package, Performance

September 20, 2026 by hgpu

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

Mingyuan Ma, Hu He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Hardware Architecture, nVidia, Package, Programming Languages

September 20, 2026 by hgpu

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

Omkar Shewale, Deepak Kumar, Divakar Kumar Yadav

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Package, Performance

September 20, 2026 by hgpu

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

Tristan Chenaille, Francesca Cuteri, Raphaël Prat, Guillaume Latu, Thomas Helfer

View

Download (PDF)

Tags: Computer science, CUDA, Factorization, Linear Algebra, nVidia, nVidia H100

September 20, 2026 by hgpu

Stencil Computation at the Intersection of AI and HPC

Timothee Ewart, Mauricio Araya-Polo

View

Download (PDF)

Tags: AI, AMD, AMD Radeon Instinct MI325X, Computer science, HPC, Intel Arc B580, Intel B70, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, nVidia RTX PRO 6000, performance portability, Stencil computation, SYCL, Triton

September 14, 2026 by hgpu

Hardware-Aware FP4 FlashAttention-4

Robert Hu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia B300, nVidia GB200, Package, PTX

September 14, 2026 by hgpu

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

Zhimin Ding, Chen-Kuan Liao, Chima Adiole, Brianna Barrow, Fangzhou Du, Yu Hsiao, Ge Huang, Yicheng Jin, Ismail Syed, Chris Jermaine

View

Download (PDF)

Source codes

Tags: AI, Computer science, CUDA, LLM, nVidia, nVidia DGX-A100, Package, Triton

September 14, 2026 by hgpu

MaxKernel: Agentic Kernel Generation for TPUs

Shangkun Wang, Nina Cai, Charles Hoong, Julian Walker, Gerson Kroiz, George Vanica, Deepak Patil, Andi Gavrilescu, Hassan Sipra, Sethu Sankaran

View

Download (PDF)

Source codes

Tags: Computer science, Package, TPU

September 14, 2026 by hgpu

Brian2 Atlas

A Unified Intermediate Representation and Execution Architecture for Heterogeneous and Distributed Neural Simulation

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelLens: Deploying Triton Kernels to C++ Inference Engines

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

Automatically Generating ML Compiler Backends from Tensor Accelerator ISA Descriptions

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

pytest-gpu-proof: Enabling Cloud-CPU Continuous Integration for GPU Code with Local GPU Attestation

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

Xtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing

DeepSeek-V4-Flash on AMD gfx90a: Correctness Recovery and Inference Performance Engineering

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws

Stencil Computation at the Intersection of AI and HPC

Hardware-Aware FP4 FlashAttention-4

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

MaxKernel: Agentic Kernel Generation for TPUs

Recent source codes

Brian2 Atlas

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

Most viewed papers (last 30 days)