high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

Communication-minimizing Asynchronous Tensor Parallelism

Siddharth Singh, Zack Sating, Abhinav Bhatele

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Neural networks, nVidia, nVidia A100

May 28, 2023 by hgpu

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

Igor Sfiligoi, Emily A. Belli, Jeff Candy, Reuben D. Budiardja

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, Fortran, MPI, nVidia, nVidia A100, OpenACC, Performance

May 21, 2023 by hgpu

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Yueming Hao, Xu Zhao, Bin Bao, David Berard, Will Constable, Adnan Aziz, Xu Liu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Benchmarking, Computer science, Deep learning, nVidia, nVidia A100, Package, PyTorch

May 14, 2023 by hgpu

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

Shixun Wu, Yujia Zhai, Jinyang Liu, Jiajun Huang, Zizhe Jian, Bryan M. Wong, Zizhong Chen

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, GEMM, Linear Algebra, Matrix multiplication, nVidia, nVidia A100, Package, Performance, Reliability, Tesla T4

May 7, 2023 by hgpu

FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs

Boyuan Zhang, Jiannan Tian, Sheng Di, Xiaodong Yu, Yunhe Feng, Xin Liang, Dingwen Tao, Franck Cappello

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia A100, nVidia RTX A4000, Package, Signal processing

May 7, 2023 by hgpu

Simple and efficient GPU accelerated topology optimisation: Codes and applications

Erik A. Träff, Anton Rydahl, Sven Karlsson, Ole Sigmund, Niels Aage

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, OpenCL, OpenMP, Package, Topology optimization problem

April 23, 2023 by hgpu

Thread-safe lattice Boltzmann for high-performance computing on GPUs

Andrea Montessori, Marco Lauricella, Adriano Tiribocchi, Mihir Durve, Michele La Rocca, Giorgio Amati, Fabio Bonaccorso, Sauro Succi

View

Download (PDF)

Source codes

Tags: Algorithms, cfd, CUDA, Fluid dynamics, Lattice Boltzmann model, nVidia, nVidia A100, Package

April 23, 2023 by hgpu

GPULZ: Optimizing LZSS Lossless Compression for Multi-byte Data on Modern GPUs

Boyuan Zhang, Jiannan Tian, Sheng Di, Xiaodong Yu, Martin Swany, Dingwen Tao, Franck Cappello

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia A100, nVidia RTX A4000, Package

April 23, 2023 by hgpu

Portability and Scalability of OpenMP Offloading on State-of-the-art Accelerators

Yehonatan Fridman, Guy Tamir, Gal Oren

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Intel, Intel Ponte Vecchio Max 1100, nVidia, nVidia A100, oneAPI, OpenMP, Package, performance portability

April 16, 2023 by hgpu

PopSparse: Accelerated block sparse matrix multiplication on IPU

Zhiyi Li, Douglas Orr, Valeriu Ohan, Godfrey Da costa, Tom Murray, Adam Sanders, Deniz Beker, Dominic Masters

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, Package, Sparse matrix

April 2, 2023 by hgpu

Pgx: Hardware-accelerated parallel game simulation for reinforcement learning

Sotetsu Koyamada, Shinri Okano, Soichiro Nishimori, Yu Murata, Keigo Habara, Haruka Kita, Shin Ishii

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, nVidia, nVidia A100, Package

April 2, 2023 by hgpu

Kernel Launcher: C++ Library for Optimal-Performance Portable CUDA Applications

Stijn Heldens, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Fluid dynamics, nVidia, nVidia A100, Package, Performance, performance portability

March 26, 2023 by hgpu

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

NVIDIA Nemotron Parse 1.1

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Communication-minimizing Asynchronous Tensor Parallelism

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs

Simple and efficient GPU accelerated topology optimisation: Codes and applications

Thread-safe lattice Boltzmann for high-performance computing on GPUs

GPULZ: Optimizing LZSS Lossless Compression for Multi-byte Data on Modern GPUs

Portability and Scalability of OpenMP Offloading on State-of-the-art Accelerators

PopSparse: Accelerated block sparse matrix multiplication on IPU

Pgx: Hardware-accelerated parallel game simulation for reinforcement learning

Kernel Launcher: C++ Library for Optimal-Performance Portable CUDA Applications

Recent source codes

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

hls4ml: Machine learning on FPGAs using HLS

ThunderKittens: Tile primitives for speedy kernels

NVIDIA Nemotron Parse 1.1

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

mt4g: Memory Topology 4 GPUs

Falcon: GPU-Based Floating-point Adaptive Lossless Compression

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

Most viewed papers (last 30 days)