high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Guilin Zhang, Wulan Guo, Ziqi Tan, Qiang Guan, Hailong Jiang

View

Download (PDF)

Source codes

Tags: Computer science, nVidia, nVidia GeForce RTX 3080, Package, Task scheduling

July 13, 2025 by hgpu

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, Jeff Hammond, Torsten Hoefler

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Network communication, nVidia, nVidia GH200

July 13, 2025 by hgpu

Serving LLMs in HPC Clusters: A Comparative Study of Qualcomm Cloud AI 100 Ultra and High-Performance GPUs

Mohammad Firas Sada, John J. Graham, Elham E Khoda, Mahidhar Tatineni, Dmitry Mishin, Rajesh K. Gupta, Rick Wagner, Larry Smarr, Thomas A. DeFanti, Frank Würthwein

View

Download (PDF)

Tags: AMD Radeon Instinct MI300A, ATI, Cloud, Computer science, Deep learning, HPC, nVidia, nVidia A100, nVidia H200

July 13, 2025 by hgpu

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Joshua Bakita, James H. Anderson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, nVidia RTX 6000 Ada, Package, Task scheduling

July 13, 2025 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

Aske N. Raahauge, Martin B. Marchioro, Marc I. Løvenskjold

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Extended precision, Futhark, nVidia, nVidia A100, Package, Thesis

July 6, 2025 by hgpu

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

Weiyi Xia, Maxim Moraru, Ying Wai Li, Timothy Liao, James R. Chelikowsky, Cai-Zhuang Wang

View

Download (PDF)

Source codes

Tags: Anisotropy, Computational Physics, Condensed matter, CUDA, Machine learning, Materials Science, Neural networks, nVidia, nVidia A100, Package, Physics

July 6, 2025 by hgpu

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Joshua H. Davis, Daniel Nichols, Ishan Khillan, Abhinav Bhatele

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, OpenMP, Package

July 6, 2025 by hgpu

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

Jinliang Shi, Shigang Li, Youxuan Xu, Xueying Wang, Rongtian Fu, Zhi Ma, Tong Wu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce RTX 4090, nVidia H100, Package, Sparse matrix

July 6, 2025 by hgpu

WiLLM: An Open Wireless LLM Communication System

Boyi Liu, Yongguang Lu, Jianguo Zhao, Qiang Yang, Wen Wu, Lin Chen, Jagmohan Chauhan, Jun Zhang

View

Download (PDF)

Source codes

Tags: Computer science, LLM, Network communications, nVidia, nVidia GeForce RTX 4090, Package

June 29, 2025 by hgpu

GCStack+GCScaler: Fast and Accurate GPU Performance Analyses Using Fine-Grained Stall Cycle Accounting and Interval Analysis

Hanna Cha, Sungchul Lee, Jounghoo Lee, Yeonan Ha, Joonsung Kim, Youngsok Kim

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Design space exploration, nVidia, nVidia GeForce RTX 3070, Performance

June 29, 2025 by hgpu

No More Shading Languages: Compiling C++ to Vulkan Shaders

H. Devillers, M. Kurtenacker, R. Membarth, S. Lemme, M. Kenzel, Ö. Yazici, P. Slusallek

View

Download (PDF)

Source codes

Tags: 3D Graphics and Realism, AMD Radeon RX 7900 XT, ATI, Compilers, GLSL, nVidia, nVidia GeForce RTX 3050 Ti, nVidia GeForce RTX 4070, Package, Raytracing, Rendering, Vulkan

June 29, 2025 by hgpu

LiteGD: Lightweight and dynamic GPU Dispatching for Large-scale Heterogeneous Clusters

Kunming Zhang, Hanlong Liao, Guoming Tang

View

Download (PDF)

Tags: Computer science, GPU cluster, Heterogeneous systems, Machine learning, nVidia, nVidia A800, nVidia GeForce RTX 4090, nVidia H100, nVidia RTX A6000, nVidia V100

June 22, 2025 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Efficient GPU Implementation of Multi-Precision Integer Division

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

WiLLM: An Open Wireless LLM Communication System

GCStack+GCScaler: Fast and Accurate GPU Performance Analyses Using Fine-Grained Stall Cycle Accounting and Interval Analysis

No More Shading Languages: Compiling C++ to Vulkan Shaders

LiteGD: Lightweight and dynamic GPU Dispatching for Large-scale Heterogeneous Clusters

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)