high performance computing on graphics processing units: hgpu.org

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

Python Workflows on HPC Systems

Dominik Strassel, Philipp Reusch, Janis Keuper

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, HPC, Machine learning, nVidia, PC cluster, Python

December 6, 2020 by hgpu

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

Jianqi Lai, Hang Yu, Zhengyu Tian, Hua Li

View

Download (PDF)

Tags: cfd, CUDA, Fluid dynamics, GPU cluster, HPC, MPI, nVidia, nVidia GeForce GTX 1070, OpenMP, Tesla V100

September 27, 2020 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Communication-minimizing Asynchronous Tensor Parallelism

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Energy-Efficient GPU Clusters Scheduling for Deep Learning

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

The Application of AI Technology in GPU Scheduling Algorithm Optimization

General purpose lattice QCD code set Bridge++ 2.0 for high performance computing

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Efficient Large-Scale Language Model Training on GPU Clusters

Python Workflows on HPC Systems

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

Recent source codes

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

BoltzGen:Toward Universal Binder Design

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

Most viewed papers (last 30 days)