high performance computing on graphics processing units: hgpu.org

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

Efficient allocation of image recognition and LLM tasks on multi-GPU system

Exploring data flow design and vectorization with oneAPI for streaming applications on CPU+GPU

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

A Review of the Parallelization Strategies for Iterative Algorithms

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

SYCL compute kernels for ExaHyPE

The Celerity High-level API: C++20 for Accelerator Clusters

A ML-based resource utilization OpenCL GPU-kernel fusion model

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

GCN Inference Acceleration using High-Level Synthesis

Sylkan: Towards a Vulkan Compute Target Platform for SYCL

Efficient Large-Scale Language Model Training on GPU Clusters

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)