high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming » CUDA

Accelerating Molecular Simulations with Triton: Fused GPU Kernels for TensorNet Neural Potentials

Manpreet Singh

View

Download (PDF)

Tags: Biology, Chemistry, CUDA, Molecular dynamics, nVidia, nVidia A100, PyTorch, Triton

December 15, 2025 by hgpu

Microbenchmarking NVIDIA’s Blackwell Architecture: An in-depth Architectural Analysis

Aaron Jarmusch, Sunita Chandrasekaran

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, HPC, Machine learning, nVidia, nVidia B200, nVidia H200, PTX

December 7, 2025 by hgpu

QiMeng-Kernel: Macro-Thinking Micro-Coding Paradigm for LLM-Based High-Performance GPU Kernel Generation

Xinguo Zhu, Shaohui Peng, Jiaming Guo, Yunji Chen, Qi Guo, Yuanbo Wen, Hang Qin, Ruizhi Chen, Qirui Zhou, Ke Gao, Yanjun Wu, Chen Zhao, Ling Li

View

Download (PDF)

Tags: AI, Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Triton

November 30, 2025 by hgpu

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

Stuart H. Sul, Simran Arora, Benjamin F. Spector, Christopher Ré

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, nVidia, nVidia B200, nVidia H100, Package

November 30, 2025 by hgpu

GPU-Initiated Networking for NCCL

Khaled Hamidouche, John Bachan, Pak Markthub, Peter-Jan Gootzen, Elena Agostini, Sylvain Jeaugey, Aamir Shafi, Georgios Theodorakis, Manjunath Gorentla Venkata

View

Download (PDF)

Tags: Computer science, CUDA, Hardware Architecture, Machine learning, nVidia, nVidia H100

November 30, 2025 by hgpu

KernelBand: Boosting LLM-based Kernel Optimization with a Hierarchical and Hardware-aware Multi-armed Bandit

Dezhi Ran, Shuxiao Xie, Mingfang Ji, Ziyue Hua, Mengzhou Wu, Yuan Cao, Yuzhe Guo, Yu Hao, Linyi Li, Yitao Hu, Tao Xie

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, nVidia GeForce RTX 4090, Triton

November 30, 2025 by hgpu

AIvailable: A Software-Defined Architecture for LLM-as-a-Service on Heterogeneous and Legacy GPUs

Pedro Antunes, Ana Rita Ortigoso, Gabriel Vieira, Daniel Fuentes, Luís Frazão, Nuno Costa, António Pereira

View

Download (PDF)

Tags: AMD Radeon Pro W6600, ATI, Computer science, CUDA, Heterogeneous systems, LLM, nVidia, nVidia GeForce GTX 1660, nVidia GeForce RTX 3070, ROCm

November 23, 2025 by hgpu

ProofWright: Towards Agentic Formal Verification of CUDA

Bodhisatwa Chatterjee, Drew Zagieboylo, Sana Damani, Siva Hari, Christos Kozyrakis

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, LLM, nVidia

November 23, 2025 by hgpu

Iris: First-Class Multi-GPU Programming Experience in Triton

Muhammad Awad, Muhammad Osama, Brandon Potter

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, HIP, nVidia, Package, Python, Triton

November 23, 2025 by hgpu

Inside VOLT: Designing an Open-Source GPU Compiler

Shinnung Jeong, Chihyo Ahn, Huanzhi Pu, Jisheng Zhao, Hyesoon Kim, Blaise Tine

View

Download (PDF)

Tags: Code generation, Compilers, Computer science, CUDA, nVidia, OpenCL

November 23, 2025 by hgpu

The Anatomy of a Triton Attention Kernel

Burkhard Ringlein, Jan van Lunteren, Radu Stoica, Thomas Parnell

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, ATI, Computer science, CUDA, DSL, HIP, LLM, nVidia, nVidia H100, Performance, Programming Languages, Triton

November 23, 2025 by hgpu

PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization

Kelun Lei, Hailong Yang, Huaitao Zhang, Xin You, Kaige Zhang, Zhongzhi Luan, Yi Liu, Depei Qian

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Performance

November 16, 2025 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Accelerating Molecular Simulations with Triton: Fused GPU Kernels for TensorNet Neural Potentials

Microbenchmarking NVIDIA’s Blackwell Architecture: An in-depth Architectural Analysis

QiMeng-Kernel: Macro-Thinking Micro-Coding Paradigm for LLM-Based High-Performance GPU Kernel Generation

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

GPU-Initiated Networking for NCCL

KernelBand: Boosting LLM-based Kernel Optimization with a Hierarchical and Hardware-aware Multi-armed Bandit

AIvailable: A Software-Defined Architecture for LLM-as-a-Service on Heterogeneous and Legacy GPUs

ProofWright: Towards Agentic Formal Verification of CUDA

Iris: First-Class Multi-GPU Programming Experience in Triton

Inside VOLT: Designing an Open-Source GPU Compiler

The Anatomy of a Triton Attention Kernel

PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization

Recent source codes

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

BoltzGen:Toward Universal Binder Design

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

Most viewed papers (last 30 days)