high performance computing on graphics processing units: hgpu.org

hgpu.org » Matrix multiplication

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Genghan Zhang, Yuetong Zhao, Yanting Tao, Zhongming Yu, Guohao Dai, Sitao Huang, Yuan Wen, Pavlos Petoumenos, Yu Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

September 11, 2022 by hgpu

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, nVidia A40, Package, PyTorch

August 21, 2022 by hgpu

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Wei Sun, Ang Li, Tong Geng, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Benchmarking, Computer science, Matrix multiplication, nVidia, nVidia A100, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, PTX, Sparse matrix

June 12, 2022 by hgpu

Fast Arbitrary Precision Floating Point on FPGA

Johannes de Fine Licht, Christopher A. Pattison, Alexandros Nikolaos Ziogas, David Simmons-Duffin, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, DSP, FPGA, Matrix multiplication, Package

April 17, 2022 by hgpu

Extending SYCL’s Programming Paradigm with Tensor-based SIMD Abstractions

Wilson Feng, Shucai Yao, Kai Ting Wang, Md Aamir Raihan, Laichun Feng, Chunrong Xu

View

Download (PDF)

Tags: Benchmarking, Computer science, Heterogeneous systems, Matrix multiplication, SYCL

April 10, 2022 by hgpu

Advanced Joins on GPUs

Christos Bellas

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce GTX Titan XP, Package, Thesis

March 27, 2022 by hgpu

Heuristic Adaptability to Input Dynamics for SpMM on GPUs

Guohao Dai, Guyue Huang, Shang Yang, Zhongming Yu, Hengrui Zhang, Yufei Ding, Yuan Xie, Huazhong Yang, Yu Wang

View

Download (PDF)

Source codes

Tags: Algorithms, CUDA, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

February 20, 2022 by hgpu

FSpGEMM: An OpenCL-based HPC Framework for Accelerating General Sparse Matrix-Matrix Multiplication on FPGAs

Erfan Bank Tavakoli, Michael Riera, Masudul Hassan Quraishi, Fengbo Ren

View

Download (PDF)

Tags: Algorithms, Computer science, FPGA, HPC, Linear Algebra, Matrix multiplication, nVidia, nVidia GTX Titan X, OpenCL, Sparse matrix

December 26, 2021 by hgpu

TCUDB: Accelerating Database with Tensor Processors

Yu-Ching Hu, Yuliang Li, Hung-Wei Tseng

View

Download (PDF)

Tags: Computer science, CUDA, Databases, Machine learning, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 3090

December 19, 2021 by hgpu

High Performance GPU Code Generation for Matrix-Matrix Multiplication using MLIR: Some Early Results

Navdeep Katel, Vivek Khandelwal, Uday Bondhugula

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUBLAS, CUDA, HPC, Matrix multiplication, nVidia, nVidia GeForce RTX 3090, Package

September 5, 2021 by hgpu

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Jan Solanti, Michal Babej, Julius Ikkala, Vinod Kumar Malamal Vadakital, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce GTX 1060, nVidia GeForce GTX 2080 Ti, OpenCL, Package, Rendering, Tesla P100, Tesla V100

August 8, 2021 by hgpu

Optimization of Heterogeneous Parallel Computing Systems using Machine Learning

Devi Abhiseshu Adurti, Mohit Battu

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, Matrix multiplication, nVidia, nVidia GeForce GTX 1050 Ti, Thesis

July 4, 2021 by hgpu

* * *

KLARAPTOR: A Tool for Dynamically Finding Optimal Kernel Launch Parameters Targeting CUDA Programs

Three Contributions to the Theory and Practice of Optimizing Compilers

HETU: a high-performance distributed deep learning system targeting large-scale and automated distributed training

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

TorchOpt: an efficient library for differentiable optimization built upon PyTorch

TorchOpt: An Efficient Library for Differentiable Optimization

NaturalCC: An Open-Source Toolkit for Code Intelligence

A Study on Neural-based Code Summarization in Low-resource Settings

mt4g: Memory Topology for GPUs

Capturing the Memory Topology of GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numerical Behaviors

Fast Arbitrary Precision Floating Point on FPGA

Extending SYCL’s Programming Paradigm with Tensor-based SIMD Abstractions

Advanced Joins on GPUs

Heuristic Adaptability to Input Dynamics for SpMM on GPUs

FSpGEMM: An OpenCL-based HPC Framework for Accelerating General Sparse Matrix-Matrix Multiplication on FPGAs

TCUDB: Accelerating Database with Tensor Processors

High Performance GPU Code Generation for Matrix-Matrix Multiplication using MLIR: Some Early Results

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Optimization of Heterogeneous Parallel Computing Systems using Machine Learning

Recent source codes

KLARAPTOR: A Tool for Dynamically Finding Optimal Kernel Launch Parameters Targeting CUDA Programs

HETU: a high-performance distributed deep learning system targeting large-scale and automated distributed training

SYCL-DNN: a library implementing neural network algorithms written using SYCL

SW#SYCL

Flink-TornadoVM-Artifact

StateMover: a checkpoint-based debugging framework for FPGAs

Kernel Tuner

TorchOpt: an efficient library for differentiable optimization built upon PyTorch

NaturalCC: An Open-Source Toolkit for Code Intelligence

mt4g: Memory Topology for GPUs

Most viewed papers (last 30 days)