high performance computing on graphics processing units: hgpu.org

hgpu.org » Matrix multiplication

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

Jinliang Shi, Shigang Li, Youxuan Xu, Xueying Wang, Rongtian Fu, Zhi Ma, Tong Wu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce RTX 4090, nVidia H100, Package, Sparse matrix

July 6, 2025 by hgpu

A Novel Compiler Transformation for Fast Sparse Matrix Multiplication in GPUs

Hossein Albakri, Kazem Cheshmi

View

Download (PDF)

Tags: Compilers, Computer science, CUBLAS, CUDA, Machine learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, Programming Languages, Sparse matrix

June 22, 2025 by hgpu

WgPy: GPU-accelerated NumPy-like array library for web browsers

Masatoshi Hidaka, Tatsuya Harada

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 4070, Python

March 10, 2025 by hgpu

On the Partitioning of GPU Power among Multi-Instances

Tirth Vamja, Kaustabha Ray, Felix George, UmaMaheswari C Devi

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia V100, Performance

February 3, 2025 by hgpu

Utilizing Tensor Cores in Futhark

Kristoffer August Kortbæk, Rune Ejnar Bang Lejbølle

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, High-level Languages, Matrix multiplication, nVidia, nVidia A100, Package, PTX

December 24, 2024 by hgpu

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Ezhilmathi Krishnasamy, Pascal Bouvry

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUDA, Differential equations, HPC, Linear Algebra, Matrix multiplication, nVidia, nVidia A100, OpenACC, Package, Partial differential equations, PDEs, Performance

December 24, 2024 by hgpu

Understanding GEMM Performance and Energy on NVIDIA Ada Lovelace: A Machine Learning-Based Analytical Approach

Xiaoteng (Frank) Liu, Pavly Halim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, GEMM, Machine learning, Matrix multiplication, nVidia, nVidia GeForce RTX 4070, Package, Performance

December 1, 2024 by hgpu

Improving Parallel Program Performance Through DSL-Driven Code Generation with LLM Optimizers

Anjiang Wei, Allen Nie, Thiago S. F. X. Teixeira, Rohan Yadav, Wonchan Lee, Ke Wang, Alex Aiken

View

Download (PDF)

Tags: Code generation, Computer science, DSL, LLM, Matrix multiplication, nVidia, Optimization, Tesla P100

November 17, 2024 by hgpu

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

Matteo Croci, Garth N. Wells

View

Download (PDF)

Source codes

Tags: AVX, Computer science, Finite element method, Floating point error, Intel, Matrix multiplication, Mixed precision, Package

October 27, 2024 by hgpu

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores

Shaobo Ma, Chao Fang, Haikuo Shao, Zhongfeng Wang

View

Download (PDF)

Tags: Computer science, CUDA, Data recovery, Extended precision, LLM, Matrix multiplication, nVidia, nVidia GeForce RTX 3090, Security

October 6, 2024 by hgpu

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Junqing Lin, Jingwei Sun, Xiaolong Shi, Honghe Zhang, Xianzhi Yu, Xinzhi Wang, Jun Yao, Guangzhong Sun

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080 Ti, Performance, Sparse matrix, Tesla V100

August 4, 2024 by hgpu

How much can we gain from Tensor Kernel Fusion on GPUs?

Wei Sun, Ang Li, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, nVidia H100

June 16, 2024 by hgpu

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

KISim: Kubernetes Intelligent Scheduling Simulator

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Efficient GPU Implementation of Multi-Precision Integer Division

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

No More Shading Languages: Compiling C++ to Vulkan Shaders

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

Engineering Supercomputing Platforms for Biomolecular Applications

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

A Novel Compiler Transformation for Fast Sparse Matrix Multiplication in GPUs

WgPy: GPU-accelerated NumPy-like array library for web browsers

On the Partitioning of GPU Power among Multi-Instances

Utilizing Tensor Cores in Futhark

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Understanding GEMM Performance and Energy on NVIDIA Ada Lovelace: A Machine Learning-Based Analytical Approach

Improving Parallel Program Performance Through DSL-Driven Code Generation with LLM Optimizers

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

How much can we gain from Tensor Kernel Fusion on GPUs?

Recent source codes

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

KISim: Kubernetes Intelligent Scheduling Simulator

Efficient GPU Implementation of Multi-Precision Integer Division

exa-AMD: Exascale Accelerated Materials Discovery

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

Most viewed papers (last 30 days)