high performance computing on graphics processing units: hgpu.org

Changxin Ke, Rui Zhang, Shuo Wang, Li Ding, Guangli Li, Yuanbo Wen, Shuoming Zhang, Ruiyuan Xu, Jin Qin, Jiaming Guo, Chenxi Wang, Ling Li, Qi Guo, Yunji Chen

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, HPC, LLM, Machine learning, nVidia, nVidia A100, nVidia GeForce RTX 4090, Package

July 13, 2025 by hgpu

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Guilin Zhang, Wulan Guo, Ziqi Tan, Qiang Guan, Hailong Jiang

View

Download (PDF)

Source codes

Tags: Computer science, nVidia, nVidia GeForce RTX 3080, Package, Task scheduling

July 13, 2025 by hgpu

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, Jeff Hammond, Torsten Hoefler

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Network communication, nVidia, nVidia GH200

July 13, 2025 by hgpu

HipKittens: Fast and Furious AMD Kernels

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

LC Framework

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

pplx-garden: Perplexity open source garden for inference technology

RDMA Point-to-Point Communication for LLM Systems

OpScanner

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

Enhancing Transformer Performance and Portability through Auto-tuning Frameworks

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

GBOTuner: Autotuning of OpenMP Parallel Codes with Bayesian Optimization and Code Representation Transfer Learning

Geak: Introducing Triton Kernel AI Agent & Evaluation Benchmarks

OpenDwarfs 2025: Modernizing the OpenDwarfs Benchmark Suite for Heterogeneous Computing

Performance Portable Gradient Computations Using Source Transformation

Kevin: Multi-Turn RL for Generating CUDA Kernels

Specx: a C++ task-based runtime system for heterogeneous distributed architectures

Pre-Training LLMs on a budget: A comparison of three optimizers

Dissecting the NVIDIA Blackwell Architecture with Microbenchmarks

Using Deep Reinforcement Learning for Automatic Code Optimization in the MLIR Compiler

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Recent source codes

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

mt4g: Memory Topology 4 GPUs

Falcon: GPU-Based Floating-point Adaptive Lossless Compression

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

LC Framework

pplx-garden: Perplexity open source garden for inference technology

OpScanner

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

Most viewed papers (last 30 days)