high performance computing on graphics processing units: hgpu.org

Qian Gong, Jieyang Chen, Ben Whitney, Xin Liang, Viktor Reshniak, Tania Banerjee, Jaemoon Lee, Anand Rangarajan, Lipeng Wan, Nicolas Vidal, Qing Liu, Ana Gainaru, Norbert Podhorszki, Richard Archibald, Sanjay Ranka, Scott Klasky

View

Download (PDF)

Source codes

Tags: Compression, Computer science, CUDA, HIP, HPC, Numerical Analysis, nVidia, nVidia V100, OpenMP, Package, SYCL

January 21, 2024 by hgpu

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Shiwei Zhang, Lansong Diao, Chuan Wu, Zongyan Cao, Siyu Wang, Wei Lin

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia A100, nVidia P100, nVidia V100, Package, PyTorch

January 14, 2024 by hgpu

Orion: Interference-aware, Fine-grained GPU Sharing for ML Applications

Foteini Strati, Xianzhe Ma, Ana Klimovic

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

January 14, 2024 by hgpu

HPCToolkit

Refining HPCToolkit for application performance analysis at exascale

Open Catalog of Best Practices for Modernization and Optimization

Optimizing the Weather Research and Forecasting Model with OpenMP Offload and Codee

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

Exploring Scalability in C++ Parallel STL Implementations

$3D-fractal-generators$

3D-fractal-generators

Double-Precision Floating-Point Data Visualizations Using Vulkan API

VerCors: a verification toolset for verifying parallel and concurrent software

The VerCors Verifier: A Progress Report

HiCCL: A hierarchical collective communications library with portable optimizations

HiCCL: A Hierarchical Collective Communication Library

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Gallatin: A General-Purpose GPU Memory Manager

Deductive verification for SYCL

High-order thread-safe lattice Boltzmann model for HPC turbulent flow simulations

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

Lessons Learned Migrating CUDA to SYCL: A HEP Case Study with ROOT RDataFrame

Parallel and Heterogeneous Timing Analysis: Partition, Algorithm, and System

MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Orion: Interference-aware, Fine-grained GPU Sharing for ML Applications

Recent source codes

HPCToolkit

Open Catalog of Best Practices for Modernization and Optimization

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

GPU-Smash: Compression abstraction library

Noarr Structures

SyncPerformance

3D-fractal-generators

VerCors: a verification toolset for verifying parallel and concurrent software

HiCCL: A hierarchical collective communications library with portable optimizations

Most viewed papers (last 30 days)