high performance computing on graphics processing units: hgpu.org

hgpu.org » Sparse matrix

Fully-Automated Code Generation for Efficient Computation of Sparse Matrix Permanents on GPUs

Deniz Elbek, Kamer Kaya

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, nVidia, nVidia A100, nVidia Quadro GV100, PTX, Sparse matrix

February 3, 2025 by hgpu

General-Purpose Computing on Tensor Processors

Kuan-Chieh Hsu

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Heterogeneous systems, Machine learning, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, nVidia Jetson Nano, Package, Sparse matrix, Thesis, TPU

October 27, 2024 by hgpu

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Junqing Lin, Jingwei Sun, Xiaolong Shi, Honghe Zhang, Xianzhi Yu, Xinzhi Wang, Jun Yao, Guangzhong Sun

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080 Ti, Performance, Sparse matrix, Tesla V100

August 4, 2024 by hgpu

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Jianhua Gao, Weixing Ji, Yizhuo Wang

View

Download (PDF)

Tags: Computer science, CUDA, Linear Algebra, nVidia, Optimization, Sparse matrix, Tesla V100

July 14, 2024 by hgpu

A Systematic Literature Survey of Sparse Matrix-Vector Multiplication

Jianhua Gao, Bingjie Liu, Weixing Ji, Hua Huang

View

Download (PDF)

Tags: Computer science, FPGA, Heterogeneous systems, Linear Algebra, Machine learning, Overview, Sparse matrix

April 14, 2024 by hgpu

Seer: Predictive Runtime Kernel Selection for Irregular Problems

Ryan Swann, Muhammad Osama, Karthik Sangaiah, Jalal Mahmud

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, Linear Algebra, load balancing, Performance, Sparse matrix

April 7, 2024 by hgpu

RDMA-Based Algorithms for Sparse Matrix Multiplication on GPUs

Benjamin Brock, Aydın Buluç, Katherine Yelick

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, MPI, nVidia, nVidia DGX-2, Sparse matrix, Tesla V100

December 3, 2023 by hgpu

Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPU

Mohammad Zubair, Christoph Bauinger

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Intel, Intel Data Center GPU Max 1550, Linear Algebra, Machine learning, Mathematical Software, Matrix multiplication, nVidia, nVidia V100, Sparse matrix, SYCL

November 5, 2023 by hgpu

Dynamic autotuning of SpMV kernel in CUSP library

Miroslav Demek

View

Download (PDF)

Tags: Auto-Tuning, Computer science, nVidia, nVidia GeForce GTX 1070, nVidia GeForce RTX 2080, Performance, Sparse matrix, Thesis

October 29, 2023 by hgpu

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

Guangsen Zeng, Yi Zou

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A40, Sparse matrix

September 6, 2023 by hgpu

PopSparse: Accelerated block sparse matrix multiplication on IPU

Zhiyi Li, Douglas Orr, Valeriu Ohan, Godfrey Da costa, Tom Murray, Adam Sanders, Deniz Beker, Dominic Masters

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, Package, Sparse matrix

April 2, 2023 by hgpu

Auto-SpMV: Automated Optimizing SpMV Kernels on GPU

Mina Ashoury, Mohammad Loni, Farshad Khunjush, Masoud Daneshtalab

View

Download (PDF)

Tags: Computer science, CUDA, Energy efficiency, Linear Algebra, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 1650, Sparse matrix

February 26, 2023 by hgpu

MSCCL++: A GPU-driven communication stack for scalable AI applications

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Benchmark compute shader of Unity against InteropUnityCUDA

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

* * *

high performance computing on graphics processing units: hgpu.org

Fully-Automated Code Generation for Efficient Computation of Sparse Matrix Permanents on GPUs

General-Purpose Computing on Tensor Processors

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

A Systematic Literature Survey of Sparse Matrix-Vector Multiplication

Seer: Predictive Runtime Kernel Selection for Irregular Problems

RDMA-Based Algorithms for Sparse Matrix Multiplication on GPUs

Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPU

Dynamic autotuning of SpMV kernel in CUSP library

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

PopSparse: Accelerated block sparse matrix multiplication on IPU

Auto-SpMV: Automated Optimizing SpMV Kernels on GPU

Recent source codes

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Most viewed papers (last 30 days)