high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Hardware-Aware FP4 FlashAttention-4

Robert Hu

View

Tags: Computer science, CUDA, nVidia, nVidia B300, nVidia GB200, Package, PTX

September 14, 2026 by hgpu

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

Zhimin Ding, Chen-Kuan Liao, Chima Adiole, Brianna Barrow, Fangzhou Du, Yu Hsiao, Ge Huang, Yicheng Jin, Ismail Syed, Chris Jermaine

View

Tags: AI, Computer science, CUDA, LLM, nVidia, nVidia DGX-A100, Package, Triton

September 14, 2026 by hgpu

Taming Bitwise Behavior in GPU Kernels with Tensor Core: Black-Box Reconstruction, Compiler Enforcement, and Static Verification

Ziteng Yang, Nicholas J. Riasanovsky, Warren Deng, Vivek Sarkar

View

Tags: Computer science, CUBLAS, CUDA, nVidia, nVidia GB300, nVidia H100, PTX, Triton

September 14, 2026 by hgpu

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

Genghan Zhang, Yixin Dong, Chengze Fan, Zhichen Zeng, Yueming Yuan, Shaowei Zhu, Kunle Olukotun

View

Tags: Benchmarking, Computer science, LLM, nVidia, nVidia B200, nVidia H100, Package, PTX

August 30, 2026 by hgpu

An HPC Approach to Accelerate Tensor Decompositions

Markus Hellgren, Erna Begovic Kovac, Hans O. Karlsson, Roman Iakymchuk

View

Tags: Computer science, CUDA, HPC, nVidia, nVidia H100

August 30, 2026 by hgpu

Concurrency Response of Plain Global Loads on the NVIDIA H100

Somashekar Manjunath, Rahul Ramachandra M

View

Tags: Computer science, CUDA, Hardware Architecture, nVidia, nVidia H100, Performance

August 30, 2026 by hgpu

Benchmarking Confidential Computing Performance on NVIDIA Blackwell GPUs

Daniyal Khan, Amean Asad, Ansgar Grunseid

View

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia B200, Security

August 30, 2026 by hgpu

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

Jinjun Huang, Zhongzhen Wen, Tongtong Xu, Meng Yan, Xin Xia, Zhongxin Liu

View

Tags: Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 3090, Package, Triton

August 30, 2026 by hgpu

A Contract-Grade Verifier for LLM-Generated GPU Kernels, and a Native Blackwell Backward for the Gated-Linear-Recurrence Family

Rishi Shah, Rishav Shrestha

View

Tags: Computer science, LLM, nVidia, nVidia B200, nVidia GB200, Triton

August 17, 2026 by hgpu

Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

Matt J. Borowski, Blazej Osinski

View

Tags: Computer science, nVidia, nVidia L4, Package, PTX

August 17, 2026 by hgpu

Validation-Centric AI-Assisted GPU Porting of a 250,000+ Line Legacy Weather Simulation Code

Tetsuya Hoshino, Masaya Kato, Kazuhisa Tsuboki, Daichi Mukunoki, Takahiro Katagiri, Toshihiro Hanawa

View

Tags: AI, Code generation, Computer science, Fortran, MPI, nVidia, nVidia GH200, nVidia H100, OpenACC, OpenMP

August 17, 2026 by hgpu

CAKE: Compiler-Agent Co-Design for Frontier Kernel Evolution

Zihao Ye, Yingyi Huang, Hongyi Jin, Bohan Hou, Junru Shao, Zhongming Yu, Jinqi Chen, Meghan Cowan, Shiyi Cao, Shanli Xing, Hanfeng Chen, Vinod Grover, Tianqi Chen, Luis Ceze

View

Tags: Compilers, Computer science, CUDA, nVidia, PTX

August 17, 2026 by hgpu

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation

Introduction to Computer Vision

Introduction to Computer Vision

ACT: Accelerator Compiler Toolkit

Automatically Generating ML Compiler Backends from Tensor Accelerator ISA Descriptions

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

pytest-gpu-proof: Enabling Cloud-CPU Continuous Integration for GPU Code with Local GPU Attestation

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

nvsass-disassembler

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

EinsummableV3 - graph-based computation with tensor operations support

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

MaxKernel: Intelligent TPU Kernel Engineering Agents

MaxKernel: Agentic Kernel Generation for TPUs

See all packages

* * *

* * *

HGPU group © 2010-2026 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: