high performance computing on graphics processing units: hgpu.org

hgpu.org » Matrix multiplication

PopSparse: Accelerated block sparse matrix multiplication on IPU

Zhiyi Li, Douglas Orr, Valeriu Ohan, Godfrey Da costa, Tom Murray, Adam Sanders, Deniz Beker, Dominic Masters

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, Package, Sparse matrix

April 2, 2023 by hgpu

Harmonic CUDA: Asynchronous Programming on GPUs

Jonathan Wapman, Sean Treichler, Serban D. Porumbescu, John D. Owens

View

Download (PDF)

Tags: Computer science, CUDA, GEMM, Linear Algebra, Matrix multiplication, nVidia, nVidia A100

March 5, 2023 by hgpu

Extending MAGMA Portability with OneAPI

Anna Fortenberry, Stanimire Tomov

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce RTX 3060, oneAPI, Package, performance portability

December 25, 2022 by hgpu

GPU Load Balancing

Muhammad Osama

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, load balancing, Matrix multiplication, nVidia, nVidia A100, Package, Sparse, Thesis

December 25, 2022 by hgpu

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Genghan Zhang, Yuetong Zhao, Yanting Tao, Zhongming Yu, Guohao Dai, Sitao Huang, Yuan Wen, Pavlos Petoumenos, Yu Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

September 11, 2022 by hgpu

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, nVidia A40, Package, PyTorch

August 21, 2022 by hgpu

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Wei Sun, Ang Li, Tong Geng, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Benchmarking, Computer science, Matrix multiplication, nVidia, nVidia A100, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, PTX, Sparse matrix

June 12, 2022 by hgpu

Fast Arbitrary Precision Floating Point on FPGA

Johannes de Fine Licht, Christopher A. Pattison, Alexandros Nikolaos Ziogas, David Simmons-Duffin, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, DSP, FPGA, Matrix multiplication, Package

April 17, 2022 by hgpu

Extending SYCL’s Programming Paradigm with Tensor-based SIMD Abstractions

Wilson Feng, Shucai Yao, Kai Ting Wang, Md Aamir Raihan, Laichun Feng, Chunrong Xu

View

Download (PDF)

Tags: Benchmarking, Computer science, Heterogeneous systems, Matrix multiplication, SYCL

April 10, 2022 by hgpu

Advanced Joins on GPUs

Christos Bellas

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce GTX Titan XP, Package, Thesis

March 27, 2022 by hgpu

Heuristic Adaptability to Input Dynamics for SpMM on GPUs

Guohao Dai, Guyue Huang, Shang Yang, Zhongming Yu, Hengrui Zhang, Yufei Ding, Yuan Xie, Huazhong Yang, Yu Wang

View

Download (PDF)

Source codes

Tags: Algorithms, CUDA, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

February 20, 2022 by hgpu

FSpGEMM: An OpenCL-based HPC Framework for Accelerating General Sparse Matrix-Matrix Multiplication on FPGAs

Erfan Bank Tavakoli, Michael Riera, Masudul Hassan Quraishi, Fengbo Ren

View

Download (PDF)

Tags: Algorithms, Computer science, FPGA, HPC, Linear Algebra, Matrix multiplication, nVidia, nVidia GTX Titan X, OpenCL, Sparse matrix

December 26, 2021 by hgpu

VFLog: vertical + gpu + free join + datalog

Column-Oriented Datalog on the GPU

ViVid Project

Exploring data flow design and vectorization with oneAPI for streaming applications on CPU+GPU

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

KSig: GPU-accelerated computation of popular time series kernels

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

IterApp: Iterative Application Skeleton

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

PopSparse: Accelerated block sparse matrix multiplication on IPU

Harmonic CUDA: Asynchronous Programming on GPUs

Extending MAGMA Portability with OneAPI

GPU Load Balancing

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Fast Arbitrary Precision Floating Point on FPGA

Extending SYCL’s Programming Paradigm with Tensor-based SIMD Abstractions

Advanced Joins on GPUs

Heuristic Adaptability to Input Dynamics for SpMM on GPUs

FSpGEMM: An OpenCL-based HPC Framework for Accelerating General Sparse Matrix-Matrix Multiplication on FPGAs

Recent source codes

VFLog: vertical + gpu + free join + datalog

ViVid Project

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

KSig: GPU-accelerated computation of popular time series kernels

IterApp: Iterative Application Skeleton

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Anari-visionaray

Most viewed papers (last 30 days)