high performance computing on graphics processing units: hgpu.org

hgpu.org » GPU cluster

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David Kung, Michael Picheny

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, OpenMPI, Speech recognition, Tesla V100

July 21, 2019 by hgpu

Themis: Fair and Efficient GPU Cluster Scheduling for Machine Learning Workloads

Kshiteej Mahajan, Arjun Singhvi, Arjun Balasubramanian, Varun Batra, Surya Teja Chavali, Shivaram Venkataraman, Aditya Akella, Amar Phanishayee, Shuchi Chawla

View

Download (PDF)

Tags: Computer science, GPU cluster, Machine learning, nVidia, Task scheduling, Tesla K80, Tesla M60

July 4, 2019 by hgpu

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

Peng Sun, Wansen Feng, Ruobing Han, Shengen Yan, Yonggang Wen

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, Neural networks, nVidia, OpenMPI, Performance, Tesla P100, Tesla V100

February 24, 2019 by hgpu

SuperNeurons: FFT-based Gradient Sparsification in the Distributed Training of Deep Neural Networks

Linnan Wang, Wei Wu, Yiyang Zhao, Junyu Zhang, Hang Liu, George Bosilca, Jack Dongarra, Maurice Herlihy, Rodrigo Fonseca

View

Download (PDF)

Source codes

Tags: Compression, Computer science, CUDA, Deep learning, FFT, GPU cluster, Neural networks, nVidia, Package, Tesla P100

November 25, 2018 by hgpu

Optimizing Communication for Clusters of GPUs

Michael Wayne LeBeane

View

Download (PDF)

Tags: Computer science, GPU cluster, Memory model, Thesis

September 2, 2018 by hgpu

Scalable Breadth-First Search on a GPU Cluster

Yuechao Pan, Roger Pearce, John D. Owens

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, nVidia, OpenMP, Performance, Tesla P100

March 25, 2018 by hgpu

A multi-agent architecture for scheduling of high performance services in a GPU cluster

Joel Antonio Trejo-Sanchez, Jose Luis Lopez-Martinez, Jose Octavio Gutierrez Garcia, Julio Cesar Ramirez-Pacheco, Daniel Fajardo-Delgado

View

Download (PDF)

Tags: Computer science, GPU cluster, Heterogeneous systems

March 22, 2018 by hgpu

MiMatrix: A Massively Distributed Deep Learning Framework on a Petascale High-density Heterogeneous Cluster

Xin Chen, Hua Zhou, Yuxiang Gao, Yu Zhu, Dongyan Wang

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Deep learning, GPU cluster, Heterogeneous systems, nVidia, RDMA, Tesla P100

February 9, 2018 by hgpu

Improving Communication Performance in GPU-Accelerated HPC Clusters

Iman Faraji

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, GPU cluster, MPI, nVidia, Package, Performance, Thesis

January 28, 2018 by hgpu

Scaling Deep Learning on GPU and Knights Landing clusters

Yang You, Aydin Buluc, James Demmel

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, Deep learning, GPU cluster, Intel Xeon Phi, Machine learning, Neural networks, nVidia, Package, PC cluster, Tesla K80, Tesla M100

August 17, 2017 by hgpu

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?

Ammar Ahmad Awan, Ching-Hsiang Chu, Hari Subramoni, Dhabaleswar K. Panda

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, MPI, nVidia, nVidia DGX-1, OpenMPI, Tesla V100

August 1, 2017 by hgpu

Scalability Study of Deep Learning Algorithms in High Performance Computer Infrastructures

Francesc Sastre Cabot

View

Download (PDF)

Tags: Algorithms, Computer science, Computer vision, CUDA, Deep learning, GPU cluster, Machine learning, Neural networks, nVidia, Tesla K80, Tesla M2090, Thesis

July 22, 2017 by hgpu

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

high performance computing on graphics processing units: hgpu.org

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Themis: Fair and Efficient GPU Cluster Scheduling for Machine Learning Workloads

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

SuperNeurons: FFT-based Gradient Sparsification in the Distributed Training of Deep Neural Networks

Optimizing Communication for Clusters of GPUs

Scalable Breadth-First Search on a GPU Cluster

A multi-agent architecture for scheduling of high performance services in a GPU cluster

MiMatrix: A Massively Distributed Deep Learning Framework on a Petascale High-density Heterogeneous Cluster

Improving Communication Performance in GPU-Accelerated HPC Clusters

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?

Scalability Study of Deep Learning Algorithms in High Performance Computer Infrastructures

Recent source codes

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

GPU plugin for PySCF

QArray

Celerity: High-level C++ for Accelerator Clusters

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

OpenMC Monte Carlo Code

Polygeist: C/C++ frontend for MLIR

Parallel Gaussian process with kernel approximation in CUDA

Most viewed papers (last 30 days)