high performance computing on graphics processing units: hgpu.org

hgpu.org » Matrix multiplication

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Pablo Antonio Martínez Sánchez

View

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, performance portability, Thesis

July 16, 2023 by hgpu

Matrix Multiplication Using Only Addition

Daniel Cussen, Jeffrey D. Ullman

View

Download (PDF)

Tags: Algorithms, Computer science, Matrix multiplication

July 9, 2023 by hgpu

DGEMM on Integer Matrix Multiplication Unit

Hiroyuki Ootomo, Katsuhisa Ozaki, Rio Yokota

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia Jetson AGX Orin, nVidia RTX 6000 Ada, nVidia Titan RTX, Package

June 25, 2023 by hgpu

Accelerating 128-bit Floating-Point Matrix Multiplication on FPGAs

Fumiya Kono, Naohito Nakasato, Maho Nakata

View

Download (PDF)

Tags: Benchmarking, Computer science, Extended precision, FPGA, Matrix multiplication, OpenCL

June 11, 2023 by hgpu

Improving Energy Efficiency of Basic Linear Algebra Routines on Heterogeneous Systems with Multiple GPUs

Hadi Zamani Sabzi

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Energy-efficient computing, Factorization, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce GTX 1660, nVidia GeForce GTX 980, Thesis

May 21, 2023 by hgpu

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

Shixun Wu, Yujia Zhai, Jinyang Liu, Jiajun Huang, Zizhe Jian, Bryan M. Wong, Zizhong Chen

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, GEMM, Linear Algebra, Matrix multiplication, nVidia, nVidia A100, Package, Performance, Reliability, Tesla T4

May 7, 2023 by hgpu

PopSparse: Accelerated block sparse matrix multiplication on IPU

Zhiyi Li, Douglas Orr, Valeriu Ohan, Godfrey Da costa, Tom Murray, Adam Sanders, Deniz Beker, Dominic Masters

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, Package, Sparse matrix

April 2, 2023 by hgpu

Harmonic CUDA: Asynchronous Programming on GPUs

Jonathan Wapman, Sean Treichler, Serban D. Porumbescu, John D. Owens

View

Download (PDF)

Tags: Computer science, CUDA, GEMM, Linear Algebra, Matrix multiplication, nVidia, nVidia A100

March 5, 2023 by hgpu

Extending MAGMA Portability with OneAPI

Anna Fortenberry, Stanimire Tomov

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce RTX 3060, oneAPI, Package, performance portability

December 25, 2022 by hgpu

GPU Load Balancing

Muhammad Osama

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, load balancing, Matrix multiplication, nVidia, nVidia A100, Package, Sparse, Thesis

December 25, 2022 by hgpu

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Genghan Zhang, Yuetong Zhao, Yanting Tao, Zhongming Yu, Guohao Dai, Sitao Huang, Yuan Wen, Pavlos Petoumenos, Yu Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

September 11, 2022 by hgpu

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, nVidia A40, Package, PyTorch

August 21, 2022 by hgpu

Code generated HPC Kernels Using Llama-2-70b

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

pocl - Portable Computing Language

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

openCLDispatcher

Novel insights on atomic synchronization for sort-based group-by on GPUs

CEED Benchmarks

Performant low-order matrix-free finite element kernels on GPU architectures

Sieve: Stratified GPU-Compute Workload Sampling

* * *

high performance computing on graphics processing units: hgpu.org

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Matrix Multiplication Using Only Addition

DGEMM on Integer Matrix Multiplication Unit

Accelerating 128-bit Floating-Point Matrix Multiplication on FPGAs

Improving Energy Efficiency of Basic Linear Algebra Routines on Heterogeneous Systems with Multiple GPUs

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

PopSparse: Accelerated block sparse matrix multiplication on IPU

Harmonic CUDA: Asynchronous Programming on GPUs

Extending MAGMA Portability with OneAPI

GPU Load Balancing

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Recent source codes

Code generated HPC Kernels Using Llama-2-70b

Scope is all you need: Transforming LLMs for HPC Code

pocl - Portable Computing Language

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

openCLDispatcher

CEED Benchmarks

Sieve: Stratified GPU-Compute Workload Sampling

EngineCL: Usability and Performance in Heterogeneous Computing

Ginkgo: high-performance linear algebra library for manycore systems

AlphaFold2

Most viewed papers (last 30 days)