high performance computing on graphics processing units: hgpu.org

Stencil Computation at the Intersection of AI and HPC

Timothee Ewart, Mauricio Araya-Polo

View

Tags: AI, AMD, AMD Radeon Instinct MI325X, Computer science, HPC, Intel Arc B580, Intel B70, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, nVidia RTX PRO 6000, performance portability, Stencil computation, SYCL, Triton

September 14, 2026 by hgpu

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

Zhimin Ding, Chen-Kuan Liao, Chima Adiole, Brianna Barrow, Fangzhou Du, Yu Hsiao, Ge Huang, Yicheng Jin, Ismail Syed, Chris Jermaine

View

Download (PDF)

Source codes

Tags: AI, Computer science, CUDA, LLM, nVidia, nVidia DGX-A100, Package, Triton

September 14, 2026 by hgpu

Validation-Centric AI-Assisted GPU Porting of a 250,000+ Line Legacy Weather Simulation Code

Tetsuya Hoshino, Masaya Kato, Kazuhisa Tsuboki, Daichi Mukunoki, Takahiro Katagiri, Toshihiro Hanawa

View

Download (PDF)

Tags: AI, Code generation, Computer science, Fortran, MPI, nVidia, nVidia GH200, nVidia H100, OpenACC, OpenMP

August 17, 2026 by hgpu

Mixed-precision numerics in scientific applications: survey and perspectives

Aditya Kashi, Hao Lu, Wesley Brewer, David Rogers, Michael Matheson, Mallikarjun Shankar, Feiyi Wang

View

Download (PDF)

Tags: AI, Computer science, Mixed precision, nVidia, nVidia V100, Review

March 26, 2026 by hgpu

KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta

Gang Liao, Hongsen Qin, Ying Wang, Alicia Golden, Michael Kuchnik, Yavuz Yetim, Jia Jiunn Ang, Chunli Fu, Yihan He, Samuel Hsia, Zewei Jiang, Dianshi Li, Uladzimir Pashkevich, Varna Puvvada, Feng Shi, Matt Steiner, Ruichao Xiao, Nathan Yan, Xiayu Yu, Zhou Fang, Abdul Zainul-Abedin, Ketan Singh, Hongtao Yu, Wenyuan Chi, Barney Huang, Sean Zhang, Noah Weller, Zach Marine, Wyatt Cook, Carole-Jean Wu, Gaoxiang Liu

View

Download (PDF)

Tags: AI, AMD Radeon Instinct MI300X, AMD Radeon Instinct MI350X, ATI, Computer science, CUDA, Deep learning, Heterogeneous systems, LLM, nVidia, nVidia A100, nVidia H100, PTX, ROCm, Triton

January 4, 2026 by hgpu

Generative Video Compression: Towards 0.01% Compression Rate for Video Transmission

Xiangyu Chen, Jixiang Luo, Jingyu Xu, Fangqiu Yi, Chi Zhang, Xuelong Li

View

Download (PDF)

Tags: AI, Compression, Computer science

January 4, 2026 by hgpu

AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization

Genghan Zhang, Shaowei Zhu, Anjiang Wei, Zhenyu Song, Allen Nie, Zhen Jia, Nandita Vijaykumar, Yida Wang, Kunle Olukotun

View

Download (PDF)

Tags: AI, Benchmarking, Computer science, LLM, Machine learning, Performance

December 29, 2025 by hgpu

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

Pierre Abillama, Changwoo Lee, Juechu Dong, David Blaauw, Dennis Sylvester, Hun-Seok Kim

View

Download (PDF)

Source codes

Tags: AI, Computer science, CUDA, Machine learning, Memory, nVidia, nVidia A40, nVidia Jetson Orin Nano, Package

December 29, 2025 by hgpu

PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformations

Muhammad Usman Tariq, Abhinav Jangda, Angelica Moreira, Madan Musuvathi, Tyler Sorensen

View

Download (PDF)

Tags: AI, AMD, AMD Radeon Instinct MI200, ATI, Computer science, CUDA, HIP, HLSL, LLM, NLP, nVidia, nVidia RTX A6000

December 29, 2025 by hgpu

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

Jinwu Chen, Qidie Wu, Bin Li, Lin Ma, Xin Si, Yang Hu, Shouyi Yin, Jun Yang

View

Download (PDF)

Source codes

Tags: AI, Code generation, Computer science, CUDA, nVidia, nVidia A100, Package, PyTorch

December 21, 2025 by hgpu

QiMeng-Kernel: Macro-Thinking Micro-Coding Paradigm for LLM-Based High-Performance GPU Kernel Generation

Xinguo Zhu, Shaohui Peng, Jiaming Guo, Yunji Chen, Qi Guo, Yuanbo Wen, Hang Qin, Ruizhi Chen, Qirui Zhou, Ke Gao, Yanjun Wu, Chen Zhao, Ling Li

View

Download (PDF)

Tags: AI, Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Triton

November 30, 2025 by hgpu

A Compute Graph Simulation and Implementation Framework Targeting AMD Versal AI Engines

Jonathan Strobl, Leonardo Solis-Vasquez, Yannick Lavan, Andreas Koch

View

Download (PDF)

Tags: AI, AMD, Code generation, Computer science, FPGA

October 26, 2025 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Stencil Computation at the Intersection of AI and HPC

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

Validation-Centric AI-Assisted GPU Porting of a 250,000+ Line Legacy Weather Simulation Code

Mixed-precision numerics in scientific applications: survey and perspectives

KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta

Generative Video Compression: Towards 0.01% Compression Rate for Video Transmission

AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformations

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

QiMeng-Kernel: Macro-Thinking Micro-Coding Paradigm for LLM-Based High-Performance GPU Kernel Generation

A Compute Graph Simulation and Implementation Framework Targeting AMD Versal AI Engines

Recent source codes

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

EinsummableV3 - graph-based computation with tensor operations support

MaxKernel: Intelligent TPU Kernel Engineering Agents

Most viewed papers (last 30 days)