high performance computing on graphics processing units: hgpu.org

Nathaniel Morgan, Caleb Yenusah, Adrian Diaz, Daniel Dunning,Jacob Moore,Erin Heilman, Calvin Roth, Evan Lieberman, Steven Walton, Sarah Brown, Daniel Holladay, Marko Knezevic, Gavin Whetstone, Zachary Baker, Robert Robey

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Fortran, HIP, nVidia, Package, performance portability, Pthreads

November 10, 2024 by hgpu

Over-synchronization in GPU Programs

Ajay Nayak, Arkaprava Basu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, Package, Performance, PTX

November 10, 2024 by hgpu

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

Pascal Jahan Elahi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, MPI, nVidia, nVidia GH200, OpenMP, Package, Performance

November 10, 2024 by hgpu

MSCCL++: A GPU-driven communication stack for scalable AI applications

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Benchmark compute shader of Unity against InteropUnityCUDA

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

* * *

high performance computing on graphics processing units: hgpu.org

Packages

LLOR: Automated Repair of OpenMP Programs

Unified schemes for directive-based GPU offloading

CLUEstering: a high-performance density-based clustering library for scientific computing

PyOMP: Parallel programming for CPUs and GPUs with OpenMP and Python

Scaling SU(2) to 1000 GPUs using HiRep

Understanding GEMM Performance and Energy on NVIDIA Ada Lovelace: A Machine Learning-Based Analytical Approach

gpuPairHMM: High-speed Pair-HMM Forward Algorithm for DNA Variant Calling on GPUs

Performance portability via C++ PSTL, SYCL, OpenMP, and HIP: the Gaia AVU-GSR case study

Kokkidio: Fast, expressive, portable code, based on Kokkos and Eigen

On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures

Over-synchronization in GPU Programs

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

Recent source codes

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Most viewed papers (last 30 days)