high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications » Computer science

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, Jeff Hammond, Torsten Hoefler

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Network communication, nVidia, nVidia GH200

July 13, 2025 by hgpu

Serving LLMs in HPC Clusters: A Comparative Study of Qualcomm Cloud AI 100 Ultra and High-Performance GPUs

Mohammad Firas Sada, John J. Graham, Elham E Khoda, Mahidhar Tatineni, Dmitry Mishin, Rajesh K. Gupta, Rick Wagner, Larry Smarr, Thomas A. DeFanti, Frank Würthwein

View

Download (PDF)

Tags: AMD Radeon Instinct MI300A, ATI, Cloud, Computer science, Deep learning, HPC, nVidia, nVidia A100, nVidia H200

July 13, 2025 by hgpu

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Joshua Bakita, James H. Anderson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, nVidia RTX 6000 Ada, Package, Task scheduling

July 13, 2025 by hgpu

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Guilin Zhang, Wulan Guo, Ziqi Tan, Qiang Guan, Hailong Jiang

View

Download (PDF)

Source codes

Tags: Computer science, nVidia, nVidia GeForce RTX 3080, Package, Task scheduling

July 13, 2025 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

Aske N. Raahauge, Martin B. Marchioro, Marc I. Løvenskjold

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Extended precision, Futhark, nVidia, nVidia A100, Package, Thesis

July 6, 2025 by hgpu

P4OMP: Retrieval-Augmented Prompting for OpenMP Parallelism in Serial Code

Wali Mohammad Abdullah, Azmain Kabir

View

Download (PDF)

Tags: Code generation, Computer science, HPC, LLM, OpenMP, Software Engineering

July 6, 2025 by hgpu

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Joshua H. Davis, Daniel Nichols, Ishan Khillan, Abhinav Bhatele

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, OpenMP, Package

July 6, 2025 by hgpu

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

Jinliang Shi, Shigang Li, Youxuan Xu, Xueying Wang, Rongtian Fu, Zhi Ma, Tong Wu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce RTX 4090, nVidia H100, Package, Sparse matrix

July 6, 2025 by hgpu

WiLLM: An Open Wireless LLM Communication System

Boyi Liu, Yongguang Lu, Jianguo Zhao, Qiang Yang, Wen Wu, Lin Chen, Jagmohan Chauhan, Jun Zhang

View

Download (PDF)

Source codes

Tags: Computer science, LLM, Network communications, nVidia, nVidia GeForce RTX 4090, Package

June 29, 2025 by hgpu

Survey of HPC in US Research Institutions

Peng Shu, Junhao Chen, Zhengliang Liu, Huaqin Zhao, Xinliang Li, Tianming Liu

View

Download (PDF)

Tags: AI, Computer science, HPC, survey

June 29, 2025 by hgpu

No More Shading Languages: Compiling C++ to Vulkan Shaders

H. Devillers, M. Kurtenacker, R. Membarth, S. Lemme, M. Kenzel, Ö. Yazici, P. Slusallek

View

Download (PDF)

Source codes

Tags: 3D Graphics and Realism, AMD Radeon RX 7900 XT, ATI, Compilers, GLSL, nVidia, nVidia GeForce RTX 3050 Ti, nVidia GeForce RTX 4070, Package, Raytracing, Rendering, Vulkan

June 29, 2025 by hgpu

Omniwise: Predicting GPU Kernels Performance with LLMs

Zixian Wang, Cole Ramos, Muhammad A. Awad, Keith Lowery

View

Download (PDF)

Tags: AMD, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, Benchmarking, Computer science, LLM, Neural networks, Performance, ROCm

June 29, 2025 by hgpu

True 4-Bit Quantized CNN Training on CPU

True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

Hunting CUDA Bugs at Scale with cuFuzz

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

CONCUR: Benchmarking LLMs for Concurrent Code Generation

HIPRT: Ray Tracing using HIP

Ray Tracing using HIP

MXFP4 Training Support Codebase

Practical FP4 Training for Large-Scale MoE Models on Hopper GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Efficient GPU Implementation of Multi-Precision Integer Division

P4OMP: Retrieval-Augmented Prompting for OpenMP Parallelism in Serial Code

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

WiLLM: An Open Wireless LLM Communication System

Survey of HPC in US Research Institutions

No More Shading Languages: Compiling C++ to Vulkan Shaders

Omniwise: Predicting GPU Kernels Performance with LLMs

Recent source codes

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

HIPRT: Ray Tracing using HIP

MXFP4 Training Support Codebase

Most viewed papers (last 30 days)