high performance computing on graphics processing units: hgpu.org

Holger R. Roth, Daniel J. Beutel, Yan Cheng, Javier Fernandez Marques, Heng Pan, Chester Chen, Zhihong Zhang, Yuhong Wen, Sean Yang, Isaac (Te-Chung)Yang, Yuan-Ting Hsieh, Ziyue Xu, Daguang Xu, Nicholas D. Lane, Andrew Feng

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Computer science, nVidia, Package, Security

July 7, 2024 by hgpu

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

Ali Doosthosseini, Jonathan Decker, Hendrik Nolte, Julian M. Kunkel

View

Download (PDF)

Source codes

Tags: AI, Cloud, Computer science, HPC, LLM, nVidia, nVidia H100, Package, PC cluster

July 7, 2024 by hgpu

Towards Unified Analysis of GPU Consistency

Haining Tong, Natalia Gavrilenko, Hernán Ponce de León, Keijo Heljanko

View

Download (PDF)

Source codes

Tags: Computer science, Memory, nVidia, OpenCL, Package, PTX, Vulkan

July 7, 2024 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Applications

HiCCL: A Hierarchical Collective Communication Library

Anatomizing Deep Learning Inference in Web Browsers

HIPRT: A Ray Tracing Framework in HIP

A Comprehensive Deep Learning Library Benchmark and Optimal Library Selection

Acceleration for the many, not the few

Springald: GPU-Accelerated Window-Based Aggregates Over Out-of-Order Data Streams

A Comparison of OpenCL, CUDA, and HIP as Compilation Targets for a Functional Array Language

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Automating Heterogeneous Parallelism in Numerical Differential Equations

Supercharging Federated Learning with Flower and NVIDIA FLARE

Towards Unified Analysis of GPU Consistency

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)