high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Optimal Software Pipelining and Warp Specialization for Tensor Core GPUs

Rupanshu Soi, Rohan Yadav, Fredrik Kjolstad, Alex Aiken, Maryam Mehri Dehnavi, Michael Garland, Michael Bauer

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia B200, nVidia H100, Programming Languages

December 29, 2025 by hgpu

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

Pierre Abillama, Changwoo Lee, Juechu Dong, David Blaauw, Dennis Sylvester, Hun-Seok Kim

View

Download (PDF)

Source codes

Tags: AI, Computer science, CUDA, Machine learning, Memory, nVidia, nVidia A40, nVidia Jetson Orin Nano, Package

December 29, 2025 by hgpu

Tilus: A Tile-Level GPGPU Programming Language for Low-Precision Computation

Yaoyao Ding, Bohan Hou, Xiao Zhang, Allan Lin, Tianqi Chen, Cody Hao Yu, Yida Wang, Gennady Pekhimenko

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia H100, nVidia L40s, Package, Programming Languages, PTX, Triton

December 29, 2025 by hgpu

PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformations

Muhammad Usman Tariq, Abhinav Jangda, Angelica Moreira, Madan Musuvathi, Tyler Sorensen

View

Download (PDF)

Tags: AI, AMD, AMD Radeon Instinct MI200, ATI, Computer science, CUDA, HIP, HLSL, LLM, NLP, nVidia, nVidia RTX A6000

December 29, 2025 by hgpu

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

Songqiao Su, Xiaofei Sun, Xiaoya Li, Albert Wang, Jiwei Li, Chris Shum

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Matrix multiplication, nVidia, nVidia A100, Package

December 21, 2025 by hgpu

Beyond Code Pairs: Dialogue-Based Data Generation for LLM Code Translation

Le Chen1, Nuo Xu, Winson Chen, Bin Lei, Pei-Hung Lin, Dunzhi Zhou, Rajeev Thakur, Caiwen Ding, Ali Jannesari, Chunhua Liao

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia H200

December 21, 2025 by hgpu

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

Jinwu Chen, Qidie Wu, Bin Li, Lin Ma, Xin Si, Yang Hu, Shouyi Yin, Jun Yang

View

Download (PDF)

Source codes

Tags: AI, Code generation, Computer science, CUDA, nVidia, nVidia A100, Package, PyTorch

December 21, 2025 by hgpu

PystachIO: Efficient Distributed GPU Query Processing with PyTorch over Fast Networks & Fast Storage

Jigao Luo, Nils Boeschen, Muhammad El-Hindi, Carsten Binnig

View

Download (PDF)

Tags: Computer science, CUDA, Databases, GPU cluster, nVidia, nVidia A100, nVidia DGX-1, PyTorch

December 21, 2025 by hgpu

Accurate Models of NVIDIA Tensor Cores

Faizan A. Khattak, Mantas Mikaitis

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia B200, nVidia H100, nVidia V100, Package

December 15, 2025 by hgpu

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

Haonan Li, Keyu Man, Partha Kanuparthy, Hanning Chen, Wei Sun, Sreen Tallam, Chenguang Zhu, Kevin Zhu, Zhiyun Qian

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, Machine learning, nVidia, nVidia H100, Package, PyTorch, Triton

December 15, 2025 by hgpu

Accelerating Molecular Simulations with Triton: Fused GPU Kernels for TensorNet Neural Potentials

Manpreet Singh

View

Download (PDF)

Tags: Biology, Chemistry, CUDA, Molecular dynamics, nVidia, nVidia A100, PyTorch, Triton

December 15, 2025 by hgpu

Microbenchmarking NVIDIA’s Blackwell Architecture: An in-depth Architectural Analysis

Aaron Jarmusch, Sunita Chandrasekaran

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, HPC, Machine learning, nVidia, nVidia B200, nVidia H200, PTX

December 7, 2025 by hgpu

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

BioAgent Bench: An AI Agent Evaluation Suite for Bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)

Awesome LLM-Driven Kernel Generation

Towards Automated Kernel Generation in the Era of LLMs

PhysProver: Advancing Automatic Theorem Proving for Physics

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Tilus: A Tile-Level GPGPU Programming Language for Low-Precision Computation

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Optimal Software Pipelining and Warp Specialization for Tensor Core GPUs

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

Tilus: A Tile-Level GPGPU Programming Language for Low-Precision Computation

PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformations

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

Beyond Code Pairs: Dialogue-Based Data Generation for LLM Code Translation

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

PystachIO: Efficient Distributed GPU Query Processing with PyTorch over Fast Networks & Fast Storage

Accurate Models of NVIDIA Tensor Cores

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

Accelerating Molecular Simulations with Triton: Fused GPU Kernels for TensorNet Neural Potentials

Microbenchmarking NVIDIA’s Blackwell Architecture: An in-depth Architectural Analysis

Recent source codes

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Awesome LLM-Driven Kernel Generation

PhysProver: Advancing Automatic Theorem Proving for Physics

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

Most viewed papers (last 30 days)