high performance computing on graphics processing units: hgpu.org

hgpu.org » Performance

Towards Calculating HPC CUDA Kernel Performance on Nvidia GPUs

Dumeni Manatschal

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia GeForce RTX 3080, Performance, PTX, Thesis

September 14, 2025 by hgpu

An HPC Benchmark Survey and Taxonomy for Characterization

Andreas Herten, Olga Pearce, Filipe S. M. Guimarães

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Fortran, HIP, HPC, MPI, OpenACC, OpenCL, OpenMP, Package, Performance, ROCm, SYCL

September 14, 2025 by hgpu

High Performance Matrix Multiplication

Ethan Davis

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, nVidia, OpenMP, Package, Performance, Python, Tesla V100

September 14, 2025 by hgpu

Accelerating a Linear Programming Algorithm on AMD GPUs

Xiyan Hu, Titus Parker, Connor Phillips, Yifa Yu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, AMD Radeon Instinct MI325X, ATI, Computer science, HIP, nVidia, nVidia A100, Package, Performance, PyTorch, ROCm, Thesis

August 31, 2025 by hgpu

Inter-APU Communication on AMD MI300A Systems via Infinity Fabric: a Deep Dive

Gabin Schieffer, Jacob Wahlgren, Ruimin Shi, Edgar A. León, Roger Pearce, Maya Gokhale, Ivy Peng

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300A, APU, ATI, Benchmarking, Computer science, HIP, HPC, MPI, Performance

August 24, 2025 by hgpu

Profiling Concurrent Vision Inference Workloads on NVIDIA Jetson – Extended

Abhinaba Chakraborty, Wouter Tavernier, Akis Kourtis, Mario Pickavet, Andreas Oikonomakis, Didier Colle

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia Jetson Nano, nVidia Jetson Orin Nano, Performance

August 24, 2025 by hgpu

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Jiarong Xing, Yifan Qiao, Simon Mo, Xingqi Cui, Gur-Eyal Sela, Yang Zhou, Joseph Gonzalez, Ion Stoica

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Performance, PyTorch

August 24, 2025 by hgpu

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

Oscar Amoros, Albert Andaluz, Johnny Nunez, Antonio J. Pena

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, Package, Performance

August 17, 2025 by hgpu

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Daichi Mukunoki

View

Download (PDF)

Source codes

Tags: Computer science, Matrix multiplication, nVidia, nVidia GeForce RTX 5060 Ti, Package, Performance

August 10, 2025 by hgpu

Kevin: Multi-Turn RL for Generating CUDA Kernels

Carlo Baronio, Pietro Marsella, Ben Pan, Simon Guo, Silas Alberti

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia H100, nVidia H200, Performance

July 20, 2025 by hgpu

Dissecting the NVIDIA Blackwell Architecture with Microbenchmarks

Aaron Jarmusch, Nathan Graddon, Sunita Chandrasekaran

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, HPC, nVidia, nVidia GeForce RTX 5080, nVidia H100, Performance, PTX

July 20, 2025 by hgpu

Omniwise: Predicting GPU Kernels Performance with LLMs

Zixian Wang, Cole Ramos, Muhammad A. Awad, Keith Lowery

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, Benchmarking, Computer science, LLM, Neural networks, Performance, ROCm

June 29, 2025 by hgpu

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

pplx-garden: Perplexity open source garden for inference technology

RDMA Point-to-Point Communication for LLM Systems

LC Framework

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Towards Calculating HPC CUDA Kernel Performance on Nvidia GPUs

An HPC Benchmark Survey and Taxonomy for Characterization

High Performance Matrix Multiplication

Accelerating a Linear Programming Algorithm on AMD GPUs

Inter-APU Communication on AMD MI300A Systems via Infinity Fabric: a Deep Dive

Profiling Concurrent Vision Inference Workloads on NVIDIA Jetson – Extended

Towards Efficient and Practical GPU Multitasking in the Era of LLM

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Kevin: Multi-Turn RL for Generating CUDA Kernels

Dissecting the NVIDIA Blackwell Architecture with Microbenchmarks

Omniwise: Predicting GPU Kernels Performance with LLMs

Recent source codes

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

mt4g: Memory Topology 4 GPUs

Falcon: GPU-Based Floating-point Adaptive Lossless Compression

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

pplx-garden: Perplexity open source garden for inference technology

LC Framework

Most viewed papers (last 30 days)