high performance computing on graphics processing units: hgpu.org

hgpu.org » Benchmarking

Evaluating the Applicability of LLM Inference Optimizations on Apple Silicon

Kyrylo Yemets, Andrii Yaroshevych, Victor Muryn, Ostap Khomenko, Pavlo Kryven, Maksym Kmet, Maksym Shamrai, Mariya Hirna

View

Download (PDF)

Tags: Apple, Apple M2 Pro, Apple M3 Ultra, Apple M4 Pro, Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 4090

October 28, 2026 by hgpu

HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills

Yakup Koray Budanaz, Lorenzo Paleari, Marcin Copik, Alexandru Calotoiu, Timo Schneider, Benjamin Chen Ming Choong, Shriram Chandran, Lars Hulsbergen, Levi Widmer, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: AMD, ATI, Benchmarking, Computer science, CUDA, Fortran, HIP, HPC, nVidia, nVidia GH200, OpenMP, Optimization, Package, Python, ROCm, Triton

October 19, 2026 by hgpu

Understanding NVIDIA Grace-Blackwell Unified Memory Through Placement-Controlled Microbenchmarks

Nathan Graddon, Aaron Jarmusch, Sunita Chandrasekaran

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Memory, nVidia, nVidia GB10, nVidia GB200, nVidia GH200, Prefetch

October 19, 2026 by hgpu

Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X

Kartik Kothalkar

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia H100, Performance, ROCm

September 28, 2026 by hgpu

Benchmarking Confidential Computing Performance on NVIDIA Blackwell GPUs

Daniyal Khan, Amean Asad, Ansgar Grunseid

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia B200, Security

August 30, 2026 by hgpu

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

Genghan Zhang, Yixin Dong, Chengze Fan, Zhichen Zeng, Yueming Yuan, Shaowei Zhu, Kunle Olukotun

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, LLM, nVidia, nVidia B200, nVidia H100, Package, PTX

August 30, 2026 by hgpu

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

Jinjun Huang, Zhongzhen Wen, Tongtong Xu, Meng Yan, Xin Xia, Zhongxin Liu

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 3090, Package, Triton

August 30, 2026 by hgpu

NVIDIA-labs OO Agents: Native Python Object-Oriented Agents

Paul Furgale, Severin Klingler, James Nolan, Matt Staats, Gaia Di Lorenzo, Elisa Martinez Abad, Christian Schüller, Razvan Dinu, Alessio Devoto, Pascal Berard, Gal Kaplun, Elad Sarafian, Riccardo Roveri, Leon Derczynski, Ricardo Silveira Cabral

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Benchmarking, Computer science, LLM, nVidia, Package, Python

August 4, 2026 by hgpu