high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Hamdy Abdelkhalik, Yehia Arafa, Nandakishore Santhi, Abdel-Hameed Badawy

View

Download (PDF)

Tags: Benchmarking, Computer science, Hardware Architecture, Latency, nVidia, nVidia A100, Performance, PTX

August 28, 2022 by hgpu

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Igor Baratta, Chris Richardson, Garth Wells

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Latency, nVidia, nVidia A100, OpenCL, Package, Performance, SYCL

August 21, 2022 by hgpu

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Philip Jon Børgesen

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Performance, Thesis

July 17, 2022 by hgpu

Just-in-Time Compilation and Link-Time Optimization for OpenMP Target Offloading

Shilei Tian, Joseph Huber, Barbara Chapman, Johannes Doerfert

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, OpenMP

July 17, 2022 by hgpu

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

Jordan Langham-Lopez, Sebastian M. Schmon, Patrick Cannon

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce GTX 1650, Performance

July 17, 2022 by hgpu

TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s

Felix Chern, Blake Hechtman, Andy Davis, Ruiqi Guo, David Majnemer, Sanjiv Kumar

View

Download (PDF)

Tags: Algorithms, Computer science, Nearest neighbour, nVidia, nVidia A100, Tesla V100, TPU

July 3, 2022 by hgpu

SnuHPL: high performance LINPACK for heterogeneous GPUs

Jinpyo Kim, Hyungdal Kwon, Jintaek Kang, Jihwan Park, Seungwook Lee, Jaejin Lee

Tags: Benchmarking, Computer science, nVidia, nVidia A100

June 26, 2022 by hgpu

Modeling GPU Dynamic Parallelism for Self Similar Density Workloads

Felipe A. Quezada, Cristóbal A. Navarro, Miguel Romero, Cristhian Aguilera

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce Titan V, nVidia Jetson NX, nVidia Titan RTX, Performance

June 12, 2022 by hgpu

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Wei Sun, Ang Li, Tong Geng, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Benchmarking, Computer science, Matrix multiplication, nVidia, nVidia A100, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, PTX, Sparse matrix

June 12, 2022 by hgpu

Onesweep: A Faster Least Significant Digit Radix Sort for GPUs

Andy Adinets, Duane Merrill

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia A100, Package, Performance, Sorting

June 12, 2022 by hgpu

Machine Learning for CUDA+MPI Design Rules

Carl Pearson, Aurya Javeed, Karen Devine

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Monte Carlo simulation, MPI, nVidia, nVidia A100

March 20, 2022 by hgpu

Benchmarking a Proof-of-Concept Performance Portable SYCL-based Fast Fourier Transformation Library

Vincent R. Pascuzzi, Mehdi Goli

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, FFT, Heterogeneous systems, HIP, HPC, nVidia, nVidia A100, OpenCL, performance portability, SYCL

March 20, 2022 by hgpu

CL4SE: A Context Learning Benchmark For Software Engineering Tasks

CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Just-in-Time Compilation and Link-Time Optimization for OpenMP Target Offloading

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s

SnuHPL: high performance LINPACK for heterogeneous GPUs

Modeling GPU Dynamic Parallelism for Self Similar Density Workloads

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Onesweep: A Faster Least Significant Digit Radix Sort for GPUs

Machine Learning for CUDA+MPI Design Rules

Benchmarking a Proof-of-Concept Performance Portable SYCL-based Fast Fourier Transformation Library

Recent source codes

CL4SE: A Context Learning Benchmark For Software Engineering Tasks

CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Vortex-Optimized Light-weight Toolchain (VOLT)

SciDef: Automated Definition Extraction from Scientific Literature

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Most viewed papers (last 30 days)