high performance computing on graphics processing units: hgpu.org

hgpu.org » Matrix multiplication

TCUDB: Accelerating Database with Tensor Processors

Yu-Ching Hu, Yuliang Li, Hung-Wei Tseng

View

Tags: Computer science, CUDA, Databases, Machine learning, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 3090

December 19, 2021 by hgpu

High Performance GPU Code Generation for Matrix-Matrix Multiplication using MLIR: Some Early Results

Navdeep Katel, Vivek Khandelwal, Uday Bondhugula

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUBLAS, CUDA, HPC, Matrix multiplication, nVidia, nVidia GeForce RTX 3090, Package

September 5, 2021 by hgpu

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Jan Solanti, Michal Babej, Julius Ikkala, Vinod Kumar Malamal Vadakital, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce GTX 1060, nVidia GeForce GTX 2080 Ti, OpenCL, Package, Rendering, Tesla P100, Tesla V100

August 8, 2021 by hgpu

Optimization of Heterogeneous Parallel Computing Systems using Machine Learning

Devi Abhiseshu Adurti, Mohit Battu

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, Matrix multiplication, nVidia, nVidia GeForce GTX 1050 Ti, Thesis

July 4, 2021 by hgpu

Accelerating Sparse Approximate Matrix Multiplication on GPUs

Xiaoyan Liu, Yi Liu, Ming Dun, Bohong Yin, Hailong Yang, Zhongzhi Luan, Depei Qian

View

Download (PDF)

Tags: Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, nVidia, Performance, Sparse matrix, Tesla V100

March 28, 2021 by hgpu

Evaluating the Performance and Portability of Contemporary SYCL Implementations

Beau Johnston, Jeffrey S. Vetter, Josh Milthorpe

View

Download (PDF)

Source codes

Tags: AMD Radeon VII, ATI, Benchmarking, Computer science, CUDA, Heterogeneous systems, HIP, Matrix multiplication, nVidia, OpenCL, Package, Performance, Tesla P100

November 29, 2020 by hgpu

OpenCL Performance on the Intel Heterogeneous Architecture Research Platform

Steven Harris, Roger D. Chamberlain, Christopher Gill

View

Download (PDF)

Tags: Computer science, FPGA, Heterogeneous systems, Matrix multiplication, OpenCL, Optimization, performance portability

October 25, 2020 by hgpu

Flexible Performant GEMM Kernels on GPUs

Thomas Faingnaert, Tim Besard, Bjorn De Sutter

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Julia, Machine learning, Mathematical Software, Matrix multiplication, Mixed precision, nVidia, nVidia GeForce RTX 2080 Ti, Package, Performance

October 4, 2020 by hgpu

Accelerating Sparse Matrix-Matrix Multiplication with GPU Tensor Cores

Orestis Zachariadis, Nitin Satpute, Juan Gómez-Luna, Joaquín Olivares

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, Mixed precision, nVidia, nVidia GeForce RTX 2070, nVidia Titan RTX, Package, Performance, Sparse matrix

October 4, 2020 by hgpu

Heterogeneous parallel computing for image registration and linear algebra applications

Orestis Zachariadis

View

Download (PDF)

Source codes

Tags: CUDA, Heterogeneous systems, Image processing, Image registration, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce GTX 1050, nVidia GeForce RTX 2070, Package, Sparse matrix, Thesis

August 9, 2020 by hgpu

Optimizing Block-Sparse Matrix Multiplications on CUDA with TVM

Zijing Gu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, Package, Sparse matrix, Tesla T4

August 2, 2020 by hgpu

GE-SpMM: General-purpose Sparse Matrix-Matrix Multiplication on GPUs for Graph Neural Networks

Guyue Huang, Guohao Dai, Yu Wang, Huazhong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce GTX 1080 Ti, nVidia GeForce RTX 2080, Package, Sparse matrix

July 12, 2020 by hgpu

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

* * *

high performance computing on graphics processing units: hgpu.org

TCUDB: Accelerating Database with Tensor Processors

High Performance GPU Code Generation for Matrix-Matrix Multiplication using MLIR: Some Early Results

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Optimization of Heterogeneous Parallel Computing Systems using Machine Learning

Accelerating Sparse Approximate Matrix Multiplication on GPUs

Evaluating the Performance and Portability of Contemporary SYCL Implementations

OpenCL Performance on the Intel Heterogeneous Architecture Research Platform

Flexible Performant GEMM Kernels on GPUs

Accelerating Sparse Matrix-Matrix Multiplication with GPU Tensor Cores

Heterogeneous parallel computing for image registration and linear algebra applications

Optimizing Block-Sparse Matrix Multiplications on CUDA with TVM

GE-SpMM: General-purpose Sparse Matrix-Matrix Multiplication on GPUs for Graph Neural Networks

Recent source codes

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)