high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization

Kelun Lei, Hailong Yang, Huaitao Zhang, Xin You, Kaige Zhang, Zhongzhi Luan, Yi Liu, Depei Qian

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Performance

November 16, 2025 by hgpu

HipKittens: Fast and Furious AMD Kernels

William Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryann Swann, Muhammad Osama, Christopher Ré, Simran Arora

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI355X, ATI, Computer science, nVidia, nVidia B200, Package, Performance

November 16, 2025 by hgpu

MT4G: A Tool for Reliable Auto-Discovery of NVIDIA and AMD GPU Compute and Memory Topologies

Stepan Vanecek, Manuel Walter Mussbacher, Dominik Groessler, Urvij Saroliya, Martin Schulz

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI210, AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, HIP, nVidia, nVidia A100, nVidia GeForce RTX 2080, nVidia H100, nVidia Quadro P 6000, nVidia V100, Package, PTX

November 16, 2025 by hgpu

A High-Throughput GPU Framework for Adaptive Lossless Compression of Floating-Point Data

Zheng Li, Weiyan Wang, Ruiyuan Li, Chao Chen, Xianlei Long, Linjiang Zheng, Quanqing Xu, Chuanhui Yang

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, Heterogeneous systems, nVidia, nVidia GeForce RTX 5080, Package

November 16, 2025 by hgpu

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

Zijian Zhang, Rong Wang, Shiyang Li, Yuebo Luo, Mingyi Hong, Caiwen Ding

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, nVidia GeForce RTX 4090, nVidia RTX 6000 Ada, Package, Performance

November 9, 2025 by hgpu

RDMA Point-to-Point Communication for LLM Systems

Nandor Licker, Kevin Hu, Vladimir Zaytsev, Lequn Chen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H200, Package, Performance, RDMA

November 9, 2025 by hgpu

AMD MI300X GPU Performance Analysis

Chandrish Ambati, Trung Diep

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, HIP, nVidia, nVidia H100, Performance

November 9, 2025 by hgpu

FP8-Flow-MoE: A Casting-Free FP8 Recipe without Double Quantization Error

Fengjuan Wang, Zhiyi Su, Xingzhu Hu, Cheng Wang, Mou Sun

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Machine learning, nVidia, nVidia H100

November 9, 2025 by hgpu

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

Brandon Alexander Burtchell, Martin Burtscher

View

Download (PDF)

Source codes

Tags: Algorithms, Compilers, Compression, Computer science, CUDA, HIP, nVidia, nVidia GeForce GTX Titan V, nVidia GeForce RTX 3080 Ti, nVidia GeForce RTX 4090, Package

November 9, 2025 by hgpu

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

Marcin Spoczynski, Marcela S. Melara

View

Download (PDF)

Source codes

Tags: Computer science, Machine learning, nVidia, oneAPI, Package, PyTorch, Rust, Security, SYCL

November 2, 2025 by hgpu

Enhancing Transformer Performance and Portability through Auto-tuning Frameworks

Patricia Siwinska,Jie Lei,Adrian Castello,Pedro Alonso-Jord́a,Enrique S. Quintana-Orti

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Computer science, CUDA, Deep learning, Heterogeneous systems, LLM, nVidia, nVidia A100, Package, performance portability

November 2, 2025 by hgpu

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

Zhongzhen Wen, Hongyu Liu, Tingwei Zhu, Minxue Pan, Shaohua Wang, Yuanyi Lin, Kairui Liu, Tian Zhang, Xuandong Li

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, Package, PyTorch

November 2, 2025 by hgpu

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

NVIDIA Nemotron Parse 1.1

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization

HipKittens: Fast and Furious AMD Kernels

MT4G: A Tool for Reliable Auto-Discovery of NVIDIA and AMD GPU Compute and Memory Topologies

A High-Throughput GPU Framework for Adaptive Lossless Compression of Floating-Point Data

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

RDMA Point-to-Point Communication for LLM Systems

AMD MI300X GPU Performance Analysis

FP8-Flow-MoE: A Casting-Free FP8 Recipe without Double Quantization Error

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

Enhancing Transformer Performance and Portability through Auto-tuning Frameworks

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

Recent source codes

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

hls4ml: Machine learning on FPGAs using HLS

ThunderKittens: Tile primitives for speedy kernels

NVIDIA Nemotron Parse 1.1

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

mt4g: Memory Topology 4 GPUs

Falcon: GPU-Based Floating-point Adaptive Lossless Compression

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

Most viewed papers (last 30 days)