high performance computing on graphics processing units: hgpu.org

hgpu.org » Linear Algebra

ISM2: Optimizing Irregular-Shaped Matrix-Matrix Multiplication on GPUs

Cody Rivera, Jieyang Chen, Nan Xiong, Shuaiwen Leon Song, Dingwen Tao

View

Tags: Algorithms, Computer science, CUDA, GEMM, Linear Algebra, Matrix multiplication, nVidia, Tesla K40, Tesla M40, Tesla P100

February 16, 2020 by hgpu

Automatically Harnessing Sparse Acceleration

Philip Ginsbach, Bruce Collie, Michael F.P. O'Boyle

View

Download (PDF)

Tags: AMD Radeon R7, ATI, Computer science, CUDA, Fortran, Heterogeneous systems, Linear Algebra, nVidia, nVidia GeForce GTX Titan X, OpenCL, Performance

January 26, 2020 by hgpu

A Parallel Sparse Tensor Benchmark Suite on CPUs and GPUs

Jiajia Li, Mahesh Lakshminarasimhan, Xiaolong Wu, Ang Li, Catherine Olschanowsky, Kevin Barker

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Linear Algebra, Machine learning, nVidia, nVidia DGX-1, Package, Performance, Tesla P100, Tesla V100

January 12, 2020 by hgpu

A Unified Iteration Space Transformation Framework for Sparse and Dense Tensor Algebra

Ryan Senanayake, Fredrik Kjolstad, Changwan Hong, Shoaib Kamil, Saman Amarasinghe

View

Download (PDF)

Source codes

Tags: Code generation, Compilers, Computer science, CUDA, Linear Algebra, nVidia, nVidia DGX-1, Package, Sparse matrix, Tesla V100

January 5, 2020 by hgpu

FBLAS: Streaming Linear Algebra Kernels on FPGA

Tiziano De Matteis, Johannes de Fine Licht, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, FPGA, Linear Algebra, OpenCL, Package

December 1, 2019 by hgpu

A Highly Parameterizable Framework for Conditional Restricted Boltzmann Machine Based Workloads Accelerated With FPGAs and OpenCL

Zoran Jaksic, Nicola Cadenelli, David Buchaca Prats, Jorda Polo, Josep Lluis Berral Garcia, David Carrera Perez

View

Download (PDF)

Tags: Computer science, FPGA, HLS, Linear Algebra, Matrix multiplication, Neural networks, OpenCL

November 17, 2019 by hgpu

Implementing and evaluating an heterogeneous, scalable, tridiagonal linear system solver with OpenCL to target FPGAs, GPUs, and CPUs

Hamish J. Macintosh, Jasmine E. Banks, Neil A. Kelson

View

Download (PDF)

Tags: Computer science, FPGA, Linear Algebra, nVidia, nVidia Quadro M 4000, OpenCL

November 3, 2019 by hgpu

DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

Ilia Sivkov, Alfio Lazzaro, Jurg Hutter

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data mining, Linear Algebra, Machine learning, Matrix multiplication, nVidia, Package, Signal processing, Sparse matrix, Tesla P100

October 20, 2019 by hgpu

GraphBLAST: A High-Performance Linear Algebra-based Graph Framework on the GPU

Carl Yang, Aydin Buluc, John D. Owens

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, nVidia, Package, Tesla K40

August 11, 2019 by hgpu

FBLAS: Streaming Linear Algebra on FPGA

Tiziano De Matteis, Johannes de Fine Licht, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, HLS, Linear Algebra, Package

July 28, 2019 by hgpu

MagmaDNN: Towards High-Performance Data Analytics and Machine Learning for Data-Driven Scientific Computing

Daniel Nichols, Nathalie-Sofia Tomov, Frank Betancourt, Stanimire Tomov, Kwai Wong, Jack Dongarra

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Heterogeneous systems, HPC, Linear Algebra, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 1050Ti, Package

July 26, 2019 by hgpu

Cross-Platform Performance Portability Using Highly Parametrized SYCL Kernels

John Lawson, Mehdi Goli, Duncan McBain, Daniel Soutar, Louis Sugy

View

Download (PDF)

Source codes

Tags: AMD R9 Nano, ATI, BLAS, Computer science, Deep learning, Linear Algebra, Machine learning, Mathematical Software, OpenCL, Package, Performance, performance portability, SYCL

April 14, 2019 by hgpu

MSCCL++: A GPU-driven communication stack for scalable AI applications

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Benchmark compute shader of Unity against InteropUnityCUDA

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

* * *

high performance computing on graphics processing units: hgpu.org

ISM2: Optimizing Irregular-Shaped Matrix-Matrix Multiplication on GPUs

Automatically Harnessing Sparse Acceleration

A Parallel Sparse Tensor Benchmark Suite on CPUs and GPUs

A Unified Iteration Space Transformation Framework for Sparse and Dense Tensor Algebra

FBLAS: Streaming Linear Algebra Kernels on FPGA

A Highly Parameterizable Framework for Conditional Restricted Boltzmann Machine Based Workloads Accelerated With FPGAs and OpenCL

Implementing and evaluating an heterogeneous, scalable, tridiagonal linear system solver with OpenCL to target FPGAs, GPUs, and CPUs

DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

GraphBLAST: A High-Performance Linear Algebra-based Graph Framework on the GPU

FBLAS: Streaming Linear Algebra on FPGA

MagmaDNN: Towards High-Performance Data Analytics and Machine Learning for Data-Driven Scientific Computing

Cross-Platform Performance Portability Using Highly Parametrized SYCL Kernels

Recent source codes

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Most viewed papers (last 30 days)