high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications » Computer science

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

Zijian Zhang, Rong Wang, Shiyang Li, Yuebo Luo, Mingyi Hong, Caiwen Ding

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, nVidia GeForce RTX 4090, nVidia RTX 6000 Ada, Package, Performance

November 9, 2025 by hgpu

RDMA Point-to-Point Communication for LLM Systems

Nandor Licker, Kevin Hu, Vladimir Zaytsev, Lequn Chen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia H200, Package, Performance, RDMA

November 9, 2025 by hgpu

AMD MI300X GPU Performance Analysis

Chandrish Ambati, Trung Diep

View

Download (PDF)

Tags: AMD Radeon Instinct MI300X, ATI, Benchmarking, Computer science, CUDA, HIP, nVidia, nVidia H100, Performance

November 9, 2025 by hgpu

FP8-Flow-MoE: A Casting-Free FP8 Recipe without Double Quantization Error

Fengjuan Wang, Zhiyi Su, Xingzhu Hu, Cheng Wang, Mou Sun

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Machine learning, nVidia, nVidia H100

November 9, 2025 by hgpu

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

Brandon Alexander Burtchell, Martin Burtscher

View

Download (PDF)

Source codes

Tags: Algorithms, Compilers, Compression, Computer science, CUDA, HIP, nVidia, nVidia GeForce GTX Titan V, nVidia GeForce RTX 3080 Ti, nVidia GeForce RTX 4090, Package

November 9, 2025 by hgpu

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

Marcin Spoczynski, Marcela S. Melara

View

Download (PDF)

Source codes

Tags: Computer science, Machine learning, nVidia, oneAPI, Package, PyTorch, Rust, Security, SYCL

November 2, 2025 by hgpu

Serve Programs, Not Prompts

In Gim, Lin Zhong

View

Download (PDF)

Tags: Computer science, LLM, NLP

November 2, 2025 by hgpu

Enhancing Transformer Performance and Portability through Auto-tuning Frameworks

Patricia Siwinska,Jie Lei,Adrian Castello,Pedro Alonso-Jord́a,Enrique S. Quintana-Orti

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Computer science, CUDA, Deep learning, Heterogeneous systems, LLM, nVidia, nVidia A100, Package, performance portability

November 2, 2025 by hgpu

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

Zhongzhen Wen, Hongyu Liu, Tingwei Zhu, Minxue Pan, Shaohua Wang, Yuanyi Lin, Kairui Liu, Tian Zhang, Xuandong Li

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, Package, PyTorch

November 2, 2025 by hgpu

INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization Formats

Mengzhao Chen, Meng Wu, Hui Jin, Zhihang Yuan, Jing Liu, Chaoyi Zhang, Yunshui Li, Jie Huang, Jin Ma, Zeyue Xue, Zhiheng Liu, Xingyan Bin, Ping Luo

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, Package

November 2, 2025 by hgpu

A Compute Graph Simulation and Implementation Framework Targeting AMD Versal AI Engines

Jonathan Strobl, Leonardo Solis-Vasquez, Yannick Lavan, Andreas Koch

View

Download (PDF)

Tags: AI, AMD, Code generation, Computer science, FPGA

October 26, 2025 by hgpu

STARK: Strategic Team of Agents for Refining Kernels

Juncheng Dong, Yang Yang, Tao Liu, Yang Wang, Feng Qi, Vahid Tarokh, Kaushik Rangadurai, Shuang Yang

View

Download (PDF)

Tags: Benchmarking, Code generation, Computer science, LLM, nVidia, nVidia A100

October 26, 2025 by hgpu

MATLAB Tensor Core models

Accurate Models of NVIDIA Tensor Cores

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

An MLIR pipeline for offloading Fortran to FPGAs via OpenMP

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

RDMA Point-to-Point Communication for LLM Systems

AMD MI300X GPU Performance Analysis

FP8-Flow-MoE: A Casting-Free FP8 Recipe without Double Quantization Error

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

Serve Programs, Not Prompts

Enhancing Transformer Performance and Portability through Auto-tuning Frameworks

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization Formats

A Compute Graph Simulation and Implementation Framework Targeting AMD Versal AI Engines

STARK: Strategic Team of Agents for Refining Kernels

Recent source codes

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

hls4ml: Machine learning on FPGAs using HLS

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

Most viewed papers (last 30 days)