high performance computing on graphics processing units: hgpu.org

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

Python Workflows on HPC Systems

Dominik Strassel, Philipp Reusch, Janis Keuper

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, HPC, Machine learning, nVidia, PC cluster, Python

December 6, 2020 by hgpu

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

Jianqi Lai, Hang Yu, Zhengyu Tian, Hua Li

View

Download (PDF)

Tags: cfd, CUDA, Fluid dynamics, GPU cluster, HPC, MPI, nVidia, nVidia GeForce GTX 1070, OpenMP, Tesla V100

September 27, 2020 by hgpu

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, FPGA, GPU cluster, Heterogeneous systems, nVidia, Optimization, Task scheduling, Tesla K80, Tesla P100, Tesla V100

August 30, 2020 by hgpu

Ignite-GPU: a GPU-enabled in-memory computing architecture on clusters

Amir Hossein Sojoodi, Majid Salimi Beni, Farshad Khunjush

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, GPU cluster, nVidia, nVidia GeForce GTX 680, Package

August 9, 2020 by hgpu

Genomics-GPU: A Benchmark Suite for GPU-accelerated Genome Analysis

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Beehive SPIR-V Toolkit

Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

TorchBench: a collection of open source benchmarks used to evaluate PyTorch performance

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Prediction of Performance and Power Consumption of GPGPU Applications

Descend: an attempt at safe imperative GPU programming

Descend: A Safe GPU Systems Programming Language

Redwood heterogeneous framework

Redwood: Flexible and Portable Heterogeneous Tree Traversal Workloads

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Communication-minimizing Asynchronous Tensor Parallelism

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Energy-Efficient GPU Clusters Scheduling for Deep Learning

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

The Application of AI Technology in GPU Scheduling Algorithm Optimization

General purpose lattice QCD code set Bridge++ 2.0 for high performance computing

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Efficient Large-Scale Language Model Training on GPU Clusters

Python Workflows on HPC Systems

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Ignite-GPU: a GPU-enabled in-memory computing architecture on clusters

Recent source codes

Genomics-GPU: A Benchmark Suite for GPU-accelerated Genome Analysis

AutoDock for GPUs and other accelerators

spotPython: Sequential Parameter Optimization in Python

Test benchmarks for CELERITY

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Beehive SPIR-V Toolkit

TorchBench: a collection of open source benchmarks used to evaluate PyTorch performance

Prediction of Performance and Power Consumption of GPGPU Applications

Descend: an attempt at safe imperative GPU programming

Redwood heterogeneous framework

Most viewed papers (last 30 days)