high performance computing on graphics processing units: hgpu.org

hgpu.org » Distributed computing

GPU-aware Communication with UCX in Parallel Programming Models: Charm++, MPI, and Python

Jaemin Choi, Zane Fink, Sam White, Nitin Bhat, David F. Richards, Laxmikant V. Kale

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Distributed computing, MPI, nVidia, Package, Python, Tesla V100

February 28, 2021 by hgpu

Efficient MPI-based Communication for GPU-Accelerated Dask Applications

Aamir Shafi, Jahanzeb Maqbool Hashmi, Hari Subramoni, Dhabaleswar K. (DK) Panda

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, Package, Performance, Python, Tesla V100

January 31, 2021 by hgpu

StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems

Johannes de Fine Licht, Andreas Kuster, Tiziano De Matteis, Tal Ben-Nun, Dominic Hofer, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Distributed computing, FPGA, Heterogeneous systems, nVidia, OpenCL, Package, Tesla P100, Tesla V100

January 24, 2021 by hgpu

JSDoop and TensorFlow.js: Volunteer Distributed Web Browser-Based Neural Network Training

José Á. Morell, Andrés Camero, Enrique Alba

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Distributed computing, Package, TensorFlow

November 3, 2019 by hgpu

Blink: Fast and Generic Collectives for Distributed ML

Guanhua Wang, Shivaram Venkataraman, Amar Phanishayee, Jorgen Thelin, Nikhil Devanur, Ion Stoica

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Heterogeneous systems, Machine learning, nVidia, nVidia DGX-1, Tesla V100

October 20, 2019 by hgpu

Elastic deep learning in multi-tenant GPU cluster

Yidi Wu, Kaihao Ma, Xiao Yan, Zhi Liu, James Cheng

View

Download (PDF)

Tags: Computer science, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia GeForce GTX 1080 Ti, Tesla V100

September 29, 2019 by hgpu

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David Kung, Michael Picheny

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, OpenMPI, Speech recognition, Tesla V100

July 21, 2019 by hgpu

Evaluating the Arm Ecosystem for High Performance Computing

Adrian Jackson, Andrew Turner, Michele Weiland, Nick Johnson, Olly Perks, Mark Parsons

View

Download (PDF)

Tags: ARM, Benchmarking, Computer science, Distributed computing, HPC, Performance

May 1, 2019 by hgpu

Heterogeneous Distributed Big Data Clustering on Sparse Grids

David Pfander, Gregor Daiss, Dirk Pfluger

View

Download (PDF)

Source codes

Tags: Clustering, Computer science, Data mining, Distributed computing, Heterogeneous systems, Machine learning, MPI, nVidia, OpenCL, Package, performance portability, Tesla P100

February 10, 2019 by hgpu

Deep Learning by Doing: The NVIDIA Deep Learning Institute and University Ambassador Program

Xi Chen, Gregory S. Gutmann, Joe Bungo

View

Download (PDF)

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, Education, Neural networks, nVidia, OpenACC

December 23, 2018 by hgpu

On Runtime Systems for Task-based Programming on Heterogeneous Platforms

Samuel Thibault

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Heterogeneous systems, nVidia, nVidia Quadro FX 5800, OpenCL, Operating systems, StarPU, Task scheduling, Tesla C2050, Tesla K20, Tesla M2075, Thesis

December 23, 2018 by hgpu

Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation

Ammar Ahmad Awan, Jeroen Bedorf, Ching-Hsiang Chu, Hari Subramoni, Dhabaleswar K. Panda

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Distributed computing, MPI, nVidia, TensorFlow, Tesla K80

November 3, 2018 by hgpu

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers

OpenMC Monte Carlo Code

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

Polygeist: C/C++ frontend for MLIR

Retargeting and Respecializing GPU Workloads for Performance Portability

Parallel Gaussian process with kernel approximation in CUDA

Optical flow algorithms for SYCL

SYCL in the edge: performance and energy evaluation for heterogeneous acceleration

OpenMP5-Offload-OpenMC-Intel-PVC

Distributed OpenMP Offloading of OpenMC on Intel GPU MAX Accelerators

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

GPU-aware Communication with UCX in Parallel Programming Models: Charm++, MPI, and Python

Efficient MPI-based Communication for GPU-Accelerated Dask Applications

StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems

JSDoop and TensorFlow.js: Volunteer Distributed Web Browser-Based Neural Network Training

Blink: Fast and Generic Collectives for Distributed ML

Elastic deep learning in multi-tenant GPU cluster

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Evaluating the Arm Ecosystem for High Performance Computing

Heterogeneous Distributed Big Data Clustering on Sparse Grids

On Runtime Systems for Task-based Programming on Heterogeneous Platforms

Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation

Recent source codes

QArray

Celerity: High-level C++ for Accelerator Clusters

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

OpenMC Monte Carlo Code

Polygeist: C/C++ frontend for MLIR

Parallel Gaussian process with kernel approximation in CUDA

Optical flow algorithms for SYCL

OpenMP5-Offload-OpenMC-Intel-PVC

Most viewed papers (last 30 days)