high performance computing on graphics processing units: hgpu.org

hgpu.org » AMD

Leveraging AI Ecosystem for Portable and Sustainable GPU Kernels in HPC

Yanbo Zhao, Zhaonan Meng, Sai Krishna Teja Varma Manthena, Xu Liu, Ajay Panyala, Jiajia Li

View

Tags: AMD, AMD Radeon Instinct MI300X, Computer science, DSL, HPC, nVidia, nVidia GeForce RTX 4090, nVidia H100, PTX, Python, ROCm, Triton

June 17, 2026 by hgpu

Pretraining large language models with MXFP4 on Native FP4 Hardware

Musa Cim, Poovaiah Palangappa, Miro Hodak, Ravi Dwivedula, Meena Arunachalam, Mahmut Taylan Kandemir

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI355X, Computer science, LLM, Precision, ROCm

May 20, 2026 by hgpu

Kerncap: Automated Kernel Extraction and Isolation for AMD GPUs

Cole Ramos, Keith Lowery

View

Download (PDF)

Source codes

Tags: AMD, AMD Radeon Instinct MI210, AMD Radeon Instinct MI300X, AMD Radeon Pro W7900, Computer science, LLM, Package, Python, ROCm, Triton

May 11, 2026 by hgpu

Microbenchmark-Driven Analytical Performance Modeling Across Modern GPU Architectures

Aaron Jarmusch, Sunita Chandrasekaran

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI250X, AMD Radeon Instinct MI300A, Benchmarking, Computer science, CUDA, nVidia, nVidia B200

May 11, 2026 by hgpu

ARGUS: Agentic GPU Optimization Guided by Data-Flow Invariants

Haohui Mai, Xiaoyan Guo, Xiangyun Ding, Daifeng Li, Qiuchu Yu, Chenzhun Guo, Cong Wang, Jiacheng Zhao, Christos Kozyrakis, Binhang Yuan

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI300X, Computer science, DSL, LLM, Triton

May 3, 2026 by hgpu

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

Hao Wu, Qidong Zhao, Songqing Chen, Yang Chen, Yueming Hao, Tony CW Liu, Sijia Chen, Adnan Aziz, Keren Zhou

View

Download (PDF)

Source codes

Tags: AMD, AMD Radeon Instinct MI250X, Computer science, Deep learning, nVidia, nVidia GeForce RTX 4090, ROCm, Triton

March 22, 2026 by hgpu

An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU

Ruijia Yang, Zeyi Wen

View

Download (PDF)

Tags: AMD, AMD Radeon RX 7900 XT, Computer science, Heterogeneous systems, nVidia, nVidia A100, nVidia GeForce RTX 4090, Triton

March 18, 2026 by hgpu

Diagnosing FP4 inference: a layer-wise and block-wise sensitivity analysis of NVFP4 and MXFP4

Musa Cim, Burak Topcu, Mahmut Taylan Kandemir

View

Download (PDF)

Tags: AMD, Computer science, LLM, nVidia, nVidia GeForce RTX 5090, nVidia RTX PRO 6000, Precision

March 15, 2026 by hgpu

Ray Tracing using HIP

Atsushi Yoshimura, Kenta Eto, Daniel Meister, Takahiro Harada

View

Download (PDF)

Source codes

Tags: 3D Graphics and Realism, AMD, Computer science, HIP, Package, Raytracing, Rendering

March 8, 2026 by hgpu

Joint Training on AMD and NVIDIA GPUs

Jon Hu, Thomas Jia, Jing Zhu, Zhendong Yu

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI325X, Computer science, CUDA, Heterogeneous systems, nVidia, nVidia H200, ROCm

March 1, 2026 by hgpu

Execution-Centric Characterization of FP8 Matrix Cores, Asynchronous Execution, and Structured Sparsity on AMD MI300A

Aaron Jarmusch, Connor Vitz, Sunita Chandrasekaran

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI300A, Benchmarking, Computer science, HIP, Performance, ROCm

February 16, 2026 by hgpu

HetCCL: Accelerating LLM Training with Heterogeneous GPUs

Heehoon Kim, Jaehwan Lee, Taejeoung Kim, Jongwon Park, Jinpyo Kim, Pyongwon Suh, Ryan H. Choi, Sangwoo Lee, Jaejin Lee

View

Download (PDF)

Tags: AMD, AMD FirePro W7800, Computer science, Deep learning, GPU cluster, Heterogeneous systems, LLM, nVidia, Tesla V100

February 8, 2026 by hgpu

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

CuFuzz: An API-Knowledge-Graph Coverage-Driven Fuzzing Framework for CUDA Libraries

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

Analyzing the Impact of Kernel Fusion on GPU Tensor Operation Performance: A Systematic Performance Study

IntelliKit: Agent-first tooling for AMD hardware

Kerncap: Automated Kernel Extraction and Isolation for AMD GPUs

DITRON: Distributed Compiler based on Triton for Parallel Systems

DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Leveraging AI Ecosystem for Portable and Sustainable GPU Kernels in HPC

Pretraining large language models with MXFP4 on Native FP4 Hardware

Kerncap: Automated Kernel Extraction and Isolation for AMD GPUs

Microbenchmark-Driven Analytical Performance Modeling Across Modern GPU Architectures

ARGUS: Agentic GPU Optimization Guided by Data-Flow Invariants

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU

Diagnosing FP4 inference: a layer-wise and block-wise sensitivity analysis of NVFP4 and MXFP4

Ray Tracing using HIP

Joint Training on AMD and NVIDIA GPUs

Execution-Centric Characterization of FP8 Matrix Cores, Asynchronous Execution, and Structured Sparsity on AMD MI300A

HetCCL: Accelerating LLM Training with Heterogeneous GPUs

Recent source codes

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

CuFuzz: An API-Knowledge-Graph Coverage-Driven Fuzzing Framework for CUDA Libraries

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

Probe-and-Refine Tuning of Repository Guidance for AI Coding Agents

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

Most viewed papers (last 30 days)