high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

LLMPerf: GPU Performance Modeling meets Large Language Models

Khoi N.M. Nguyen, Hoang Duy Nguyen Do, Huyen Thao Le, Thanh Tuan Dao

View

Download (PDF)

Source codes

Tags: Computer science, LLM, Machine learning, nVidia, OpenCL, Performance, Tesla V100

March 23, 2025 by hgpu

WgPy: GPU-accelerated NumPy-like array library for web browsers

Masatoshi Hidaka, Tatsuya Harada

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 4070, Python

March 10, 2025 by hgpu

SUperman: Efficient Permanent Computation on GPUs

Deniz Elbek, Fatih Taşyaran, Bora Uçar, Kamer Kaya

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HPC, Numerical Analysis, nVidia, nVidia A100, nVidia Quadro GV100, OpenMPI, Package

March 10, 2025 by hgpu

Can Tensor Cores Benefit Memory-Bound Kernels? (No!)

Lingqi Zhang, Jiajun Huang, Sheng Di, Satoshi Matsuoka, Mohamed Wahib

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, Performance

March 10, 2025 by hgpu

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Changqing Shi, Yufei Sun, Rui Chen, Jiahao Wang, Qiang Guo, Chunye Gong, Yicheng Sui, Yutong Jin, Yuzhi Zhang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, HPC, Memory model, nVidia, OpenCL, Package

March 3, 2025 by hgpu

pyATF: Constraint-Based Auto-Tuning in Python

Richard Schulze, Sergei Gorlatch, Ari Rasch

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Compilers, Computer science, CUDA, nVidia A100, OpenCL, Package, Performance, Python

March 3, 2025 by hgpu

Towards Studying the Effect of Compiler Optimizations and Software Randomization on GPU Reliability

Pau López Castillón, Xavier Caricchio Hernández, Leonidas Kosmidis

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, nVidia, nVidia GeForce GTX 1080 Ti

March 3, 2025 by hgpu

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

Jianling Li, Shangzhan Li, Zhenye Gao, Qi Shi, Yuxuan Li, Zefan Wang, Jiacheng Huang, Haojie Wang, Jianrong Wang, Xu Han, Zhiyuan Liu, Maosong Sun

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, CUDA, Deep learning, LLM, nVidia, nVidia A100, Package, Python

March 3, 2025 by hgpu

CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads

Radostin Stoyanov, Viktória Spišaková, Jesus Ramos, Steven Gurfinkel, Andrei Vagin, Adrian Reber, Wesley Armour, Rodrigo Bruno

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia H100, nVidia RTX A6000, Package, ROCm

March 3, 2025 by hgpu

KernelBench: Can LLMs Write Efficient GPU Kernels?

Anne Ouyang, Simon Guo, Simran Arora, Alex L. Zhang, William Hu, Christopher Ré, Azalia Mirhoseini

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia L40s, Package, PyTorch

February 24, 2025 by hgpu

The AI CUDA Engineer: Agentic CUDA Kernel Discovery, Optimization and Composition

Robert Tjarko Lange, Aaditya Prasad, Qi Sun, Maxence Faldor, Yujin Tang, David Ha

View

Download (PDF)

Source codes

Tags: AI, Computer science, CUDA, LLM, nVidia, nVidia H100, Package, Performance

February 24, 2025 by hgpu

cuSZp2: A GPU Lossy Compressor with Extreme Throughput and Optimized Compression Ratio

Yafan Huang, Sheng Di, Guanpeng Li, Franck Cappello

View

Download (PDF)

Source codes

Tags: Compression, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3080, nVidia GeForce RTX 3090, Package, PTX

February 16, 2025 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

LLMPerf: GPU Performance Modeling meets Large Language Models

WgPy: GPU-accelerated NumPy-like array library for web browsers

SUperman: Efficient Permanent Computation on GPUs

Can Tensor Cores Benefit Memory-Bound Kernels? (No!)

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

pyATF: Constraint-Based Auto-Tuning in Python

Towards Studying the Effect of Compiler Optimizations and Software Randomization on GPU Reliability

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads

KernelBench: Can LLMs Write Efficient GPU Kernels?

The AI CUDA Engineer: Agentic CUDA Kernel Discovery, Optimization and Composition

cuSZp2: A GPU Lossy Compressor with Extreme Throughput and Optimized Compression Ratio

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)