high performance computing on graphics processing units: hgpu.org

Packages

hgpu.org » Applications

Efficient Quantized Sparse Matrix Operations on Tensor Cores

Shigang Li, Kazuki Osawa, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Linear Algebra, Mixed precision, nVidia, nVidia A100, Package, Sparse matrix, Tesla V100

October 2, 2022 by hgpu

Exploiting dynamic sparse matrices for performance portable linear algebra operations

Chris Stylianou, Michele Weiland

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, HPC, Linear Algebra, MPI, nVidia, OpenMP, Package, Sparse matrix, Tesla V100

October 2, 2022 by hgpu

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, NLP, nVidia, nVidia A100, Package

September 11, 2022 by hgpu

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Genghan Zhang, Yuetong Zhao, Yanting Tao, Zhongming Yu, Guohao Dai, Sitao Huang, Yuan Wen, Pavlos Petoumenos, Yu Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

September 11, 2022 by hgpu

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Re'em Harel, Matan Rusanovsky, Ron Wagner, Harel Levin, Gal Oren

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Fortran, HPC, MPI, Package, Performance

September 11, 2022 by hgpu

Lina: a fast design optimisation tool for software-based FPGA programming

Andre Bannwart Perina

View

Download (PDF)

Source codes

Tags: Computer science, Design space exploration, FPGA, nVidia, nVidia Quadro K620, OpenCL, Package, Thesis

September 4, 2022 by hgpu

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Jhe-Yu Liou, Muaaz Awan, Steven Hofmeyr, Stephanie Forrest, Carole-Jean Wu

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, nVidia GeForce GTX 1080 Ti, Package, performance portability, Sequence alignment, Tesla P100, Tesla V100

September 4, 2022 by hgpu

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Mohammad K. Dashti

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Memory model, nVidia, nVidia GeForce RTX 2070, nVidia Jetson TK1, OpenCL, Package, Thesis

August 28, 2022 by hgpu

Fully Concurrent GPU Data Structures

Muhammad Abdelghaffar Awad

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data Structures and Algorithms, nVidia, nVidia GeForce GTX Titan V, Package, Tesla V100

August 28, 2022 by hgpu

BenchPress: A Deep Active Benchmark Generator

Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu, Chris Cummins, Kim Hazelwood, Ajitha Rajan, Hugh Leather

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, PyTorch

August 21, 2022 by hgpu

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Igor Baratta, Chris Richardson, Garth Wells

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Latency, nVidia, nVidia A100, OpenCL, Package, Performance, SYCL

August 21, 2022 by hgpu

Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training

Jie You, Jae-Won Chung, Mosharaf Chowdhury

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Energy-efficient computing, Neural networks, nVidia, Package, Tesla V100

August 21, 2022 by hgpu

Qwen3-235B @ 1M tokens on AMD MI355X

CHUNDER: Enabling Million-Token Qwen3 Serving on AMD ROCm

CUDA++ for the NVIDIA DGX Spark

Reverse Engineering the CUDA Software Stack: A Clean-Room GPU Machine-Code Toolchain for the NVIDIA GB10

ATTUNE: Agentic Throughput Tuning for LLM Training

HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills

Brian2 Atlas

A Unified Intermediate Representation and Execution Architecture for Heterogeneous and Distributed Neural Simulation

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelLens: Deploying Triton Kernels to C++ Inference Engines

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

Automatically Generating ML Compiler Backends from Tensor Accelerator ISA Descriptions

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

Efficient Quantized Sparse Matrix Operations on Tensor Cores

Exploiting dynamic sparse matrices for performance portable linear algebra operations

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Lina: a fast design optimisation tool for software-based FPGA programming

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Fully Concurrent GPU Data Structures

BenchPress: A Deep Active Benchmark Generator

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training

Recent source codes

Qwen3-235B @ 1M tokens on AMD MI355X

CUDA++ for the NVIDIA DGX Spark

ATTUNE: Agentic Throughput Tuning for LLM Training

HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills

Brian2 Atlas

AgentGarten: Code Worlds for Evolving Agents

KernelLens: Automated Triton-to-C++ Compiler for Enterprise Inference Runtimes

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

Most viewed papers (last 30 days)