high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

Jordan Langham-Lopez, Sebastian M. Schmon, Patrick Cannon

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce GTX 1650, Performance

July 17, 2022 by hgpu

TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s

Felix Chern, Blake Hechtman, Andy Davis, Ruiqi Guo, David Majnemer, Sanjiv Kumar

View

Download (PDF)

Tags: Algorithms, Computer science, Nearest neighbour, nVidia, nVidia A100, Tesla V100, TPU

July 3, 2022 by hgpu

SnuHPL: high performance LINPACK for heterogeneous GPUs

Jinpyo Kim, Hyungdal Kwon, Jintaek Kang, Jihwan Park, Seungwook Lee, Jaejin Lee

Tags: Benchmarking, Computer science, nVidia, nVidia A100

June 26, 2022 by hgpu

Modeling GPU Dynamic Parallelism for Self Similar Density Workloads

Felipe A. Quezada, Cristóbal A. Navarro, Miguel Romero, Cristhian Aguilera

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce Titan V, nVidia Jetson NX, nVidia Titan RTX, Performance

June 12, 2022 by hgpu

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Wei Sun, Ang Li, Tong Geng, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Benchmarking, Computer science, Matrix multiplication, nVidia, nVidia A100, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, PTX, Sparse matrix

June 12, 2022 by hgpu

Onesweep: A Faster Least Significant Digit Radix Sort for GPUs

Andy Adinets, Duane Merrill

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia A100, Package, Performance, Sorting

June 12, 2022 by hgpu

Machine Learning for CUDA+MPI Design Rules

Carl Pearson, Aurya Javeed, Karen Devine

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Monte Carlo simulation, MPI, nVidia, nVidia A100

March 20, 2022 by hgpu

Benchmarking a Proof-of-Concept Performance Portable SYCL-based Fast Fourier Transformation Library

Vincent R. Pascuzzi, Mehdi Goli

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, FFT, Heterogeneous systems, HIP, HPC, nVidia, nVidia A100, OpenCL, performance portability, SYCL

March 20, 2022 by hgpu

FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours

Shenggan Cheng, Ruidong Wu, Zhongming Yu, Binrui Li, Xiwen Zhang, Jian Peng, Yang You

View

Download (PDF)

Source codes

Tags: Biology, Computer science, CUDA, Machine learning, nVidia, nVidia A100, Package

March 6, 2022 by hgpu

SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets

Xiaodong Yu, Sheng Di, Kai Zhao, jiannan Tian, Dingwen Tao, Xin Liang, Franck Cappello

View

Download (PDF)

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia A100, Tesla V100

February 6, 2022 by hgpu

GC3: An Optimizing Compiler for GPU Collective Communication

Meghan Cowan, Saeed Maleki, Madanlal Musuvathi, Olli Saarikivi, Yifan Xiong

View

Download (PDF)

Tags: Algorithms, Compilers, Computer science, CUDA, Machine learning, nVidia, nVidia A100

February 6, 2022 by hgpu

Bayesian Optimization for auto-tuning GPU kernels

Floris-Jan Willemsen, Rob van Nieuwpoort, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Bayesian, Computer science, CUDA, Machine learning, nVidia, nVidia A100, nVidia GeForce GTX Titan X, nVidia GeForce RTX 2070, OpenCL, Package, Performance

December 5, 2021 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s

SnuHPL: high performance LINPACK for heterogeneous GPUs

Modeling GPU Dynamic Parallelism for Self Similar Density Workloads

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Onesweep: A Faster Least Significant Digit Radix Sort for GPUs

Machine Learning for CUDA+MPI Design Rules

Benchmarking a Proof-of-Concept Performance Portable SYCL-based Fast Fourier Transformation Library

FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours

SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets

GC3: An Optimizing Compiler for GPU Collective Communication

Bayesian Optimization for auto-tuning GPU kernels

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)