high performance computing on graphics processing units: hgpu.org

hgpu.org » Linear Algebra

CodegenBench: Can LLMs Write Efficient Code Across Architectures?

Jie Li, Wenzhao Wu, Junqi Hu, Qinrui Zheng, Bowen Wu, Juepeng Zheng, Yutong Lu, Haohuan Fu

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, HPC, Linear Algebra, LLM, nVidia, Package

June 8, 2026 by hgpu

High Performance Matrix Multiplication

Ethan Davis

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, nVidia, OpenMP, Package, Performance, Python, Tesla V100

September 14, 2025 by hgpu

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Ryan R. Curtin, Marcus Edel, Conrad Sanderson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, nVidia, nVidia GeForce RTX 2080 Ti, OpenCL, Package, Programming techniques

August 24, 2025 by hgpu

Performant Unified GPU Kernels for Portable Singular Value Computation Across Hardware and Precision

Evelyne Ringoot, Rabab Alomairy, Valentin Churavy, Alan Edelman

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, Apple M1 Pro, ATI, Computer science, HIP, Intel, Intel Ponte Vecchio Max 1100, Kokkos, Linear Algebra, Machine learning, nVidia, nVidia A100, nVidia GeForce RTX 4060, nVidia H100, OpenCL, SYCL

August 17, 2025 by hgpu

Seamless acceleration of Fortran intrinsics via AMD AI engines

Nick Brown, Gabriel Rodríguez Canal

View

Download (PDF)

Source codes

Tags: AI, AMD, Computer science, Fortran, Linear Algebra, Package, Performance

February 24, 2025 by hgpu

Forecasting time series with constraints

Nathan Doumèche, Francis Bach, Éloi Bedek, Gérard Biau, Claire Boyer, Yannig Goude

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, Linear Algebra, Machine learning, nVidia, nVidia L4, Package

February 24, 2025 by hgpu

Ilargi: a GPU Compatible Factorized ML Model Training Framework

Wenbo Sun, Rihan Hai

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, Machine learning, nVidia, nVidia A40, Package

February 10, 2025 by hgpu

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Download (PDF)

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Naifeng Zhang, Franz Franchetti

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Linear Algebra, Modular arithmetic, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia V100, Package, Security

January 20, 2025 by hgpu

Performant Automatic BLAS Offloading on Unified Memory Architecture with OpenMP First-Touch Style Data Movement

Junjie Li

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Linear Algebra, nVidia, nVidia GH200, OpenMPI, Physics, Quantum Physics

January 6, 2025 by hgpu

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Ezhilmathi Krishnasamy, Pascal Bouvry

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUDA, Differential equations, HPC, Linear Algebra, Matrix multiplication, nVidia, nVidia A100, OpenACC, Package, Partial differential equations, PDEs, Performance

December 24, 2024 by hgpu

Kokkidio: Fast, expressive, portable code, based on Kokkos and Eigen

Lennart Steffen, Reinhard Hinkelmann

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Computer science, Intel, Intel Data Center GPU Max 1550, Linear Algebra, nVidia, nVidia A100, nVidia GeForce GTX Titan V, Package, performance portability

November 17, 2024 by hgpu

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

Analyzing the Impact of Kernel Fusion on GPU Tensor Operation Performance: A Systematic Performance Study

IntelliKit: Agent-first tooling for AMD hardware

Kerncap: Automated Kernel Extraction and Isolation for AMD GPUs

DITRON: Distributed Compiler based on Triton for Parallel Systems

DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Agentic Code Optimization via Compiler-LLM Cooperation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

CodegenBench: Can LLMs Write Efficient Code Across Architectures?

High Performance Matrix Multiplication

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Performant Unified GPU Kernels for Portable Singular Value Computation Across Hardware and Precision

Seamless acceleration of Fortran intrinsics via AMD AI engines

Forecasting time series with constraints

Ilargi: a GPU Compatible Factorized ML Model Training Framework

Profiling Apple Silicon Performance for ML Training

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Performant Automatic BLAS Offloading on Unified Memory Architecture with OpenMP First-Touch Style Data Movement

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Kokkidio: Fast, expressive, portable code, based on Kokkos and Eigen

Recent source codes

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

Probe-and-Refine Tuning of Repository Guidance for AI Coding Agents

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Agentic Code Optimization via Compiler-LLM Cooperation

Most viewed papers (last 30 days)