high performance computing on graphics processing units: hgpu.org

hgpu.org » Matrix multiplication

Flexible Performant GEMM Kernels on GPUs

Thomas Faingnaert, Tim Besard, Bjorn De Sutter

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Julia, Machine learning, Mathematical Software, Matrix multiplication, Mixed precision, nVidia, nVidia GeForce RTX 2080 Ti, Package, Performance

October 4, 2020 by hgpu

Accelerating Sparse Matrix-Matrix Multiplication with GPU Tensor Cores

Orestis Zachariadis, Nitin Satpute, Juan Gómez-Luna, Joaquín Olivares

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, Mixed precision, nVidia, nVidia GeForce RTX 2070, nVidia Titan RTX, Package, Performance, Sparse matrix

October 4, 2020 by hgpu

Heterogeneous parallel computing for image registration and linear algebra applications

Orestis Zachariadis

View

Download (PDF)

Source codes

Tags: CUDA, Heterogeneous systems, Image processing, Image registration, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce GTX 1050, nVidia GeForce RTX 2070, Package, Sparse matrix, Thesis

August 9, 2020 by hgpu

Optimizing Block-Sparse Matrix Multiplications on CUDA with TVM

Zijing Gu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, Package, Sparse matrix, Tesla T4

August 2, 2020 by hgpu

GE-SpMM: General-purpose Sparse Matrix-Matrix Multiplication on GPUs for Graph Neural Networks

Guyue Huang, Guohao Dai, Yu Wang, Huazhong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce GTX 1080 Ti, nVidia GeForce RTX 2080, Package, Sparse matrix

July 12, 2020 by hgpu

Sparse GPU Kernels for Deep Learning

Trevor Gale, Matei Zaharia, Cliff Young, Erich Elsen

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, Neural networks, nVidia, Sparse matrix, Tesla V100

June 28, 2020 by hgpu

Automatic Kernel Generation for Volta Tensor Cores

Somashekaracharya G. Bhaskaracharya, Julien Demouth, Vinod Grover

View

Download (PDF)

Tags: Compilers, Computer science, CUBLAS, CUDA, Deep learning, Matrix multiplication, nVidia, nVidia Quadro GV100, Performance, Programming Languages, PTX

June 28, 2020 by hgpu

Investigating Single Precision Floating General Matrix Multiply in Heterogeneous

Steven Harris

View

Download (PDF)

Tags: ASIC, Computer science, FPGA, Heterogeneous systems, Matrix multiplication, OpenCL, Performance, performance portability, Thesis

June 7, 2020 by hgpu

Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format

Shaohuai Shi, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUBLAS, CUDA, Matrix multiplication, nVidia, nVidia GeForce GTX 980, nVidia GeForce GTX Titan X, Package, Sparse matrix, Tesla P100

June 7, 2020 by hgpu

Synergistic CPU-FPGA Acceleration of Sparse Linear Algebra

Mohammadreza Soltaniyeh, Richard P. Martin, Santosh Nagarakatte

View

Download (PDF)

Tags: Computer science, Factorization, FPGA, HLS, Linear Algebra, Matrix multiplication, OpenCL, Sparse

May 10, 2020 by hgpu

Fireiron: A Scheduling Language for High-Performance Linear Algebra on GPUs

Bastian Hagedorn, Archibald Samuel Elliott, Henrik Barthels, Rastislav Bodik, Vinod Grover

View

Download (PDF)

Tags: Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce GTX 750 Ti, nVidia GeForce RTX 2080 Ti, nVidia Quadro GV100, Programming Languages

March 22, 2020 by hgpu

A Systematic Survey of General Sparse Matrix-Matrix Multiplication

Jianhua Gao, Weixing Ji, Zhaonian Tan, Yueyan Zhao

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce GTX 1080 Ti, Sparse matrix, survey

March 1, 2020 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Flexible Performant GEMM Kernels on GPUs

Accelerating Sparse Matrix-Matrix Multiplication with GPU Tensor Cores

Heterogeneous parallel computing for image registration and linear algebra applications

Optimizing Block-Sparse Matrix Multiplications on CUDA with TVM

GE-SpMM: General-purpose Sparse Matrix-Matrix Multiplication on GPUs for Graph Neural Networks

Sparse GPU Kernels for Deep Learning

Automatic Kernel Generation for Volta Tensor Cores

Investigating Single Precision Floating General Matrix Multiply in Heterogeneous

Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format

Synergistic CPU-FPGA Acceleration of Sparse Linear Algebra

Fireiron: A Scheduling Language for High-Performance Linear Algebra on GPUs

A Systematic Survey of General Sparse Matrix-Matrix Multiplication

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)