high performance computing on graphics processing units: hgpu.org

hgpu.org » Tesla V100

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?

Ammar Ahmad Awan, Ching-Hsiang Chu, Hari Subramoni, Dhabaleswar K. Panda

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, MPI, nVidia, nVidia DGX-1, OpenMPI, Tesla V100

August 1, 2017 by hgpu

Scaling Deep Learning on GPU and Knights Landing clusters

ParTeCL: parallel testing using OpenCL

DenseNet: Densely Connected Convolutional Networks

Memory-Efficient Implementation of DenseNets

SVMbenchmark: CUDA and OpenCL SVM training benchmark

A Comparison of Support Vector Machines Training GPU-Accelerated Open Source Implementations

See all packages

* * *

2018

February

26-28

Singapore

International Conference on Intelligent Autonomous Systems (ICIAS), 2018

2018

February

21-23

Amsterdam, Netherlands

International Conference on Robotics and Intelligent System (ICRIS), 2018

2018

February

24-26

Hong Kong

International Conference on Image and Graphics Processing (ICIGP), 2018

2018

January

18-20

Tokyo, Japan

8th International Conference on Bioscience, Biochemistry and Bioinformatics (ICBBB), 2018

2018

January

8-10

Sydney, Australia

The 10th International Conference on Computer Modeling and Simulation (ICCMS), 2018

Add event

See all events

high performance computing on graphics processing units: hgpu.org

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?

Recent source codes

Scaling Deep Learning on GPU and Knights Landing clusters

Gpufit: GPU-accelerated Levenberg-Marquardt curve fitting in CUDA

GARDENIA: Graph Analytics Repository for Designing Next-Generation Accelerators

GPU-benchmarks

bit-reversal-methods

bifrost: A stream processing framework for high-throughput applications

NEMATUS: Open-Source Neural Machine Translation in Theano

ParTeCL: parallel testing using OpenCL

DenseNet: Densely Connected Convolutional Networks

SVMbenchmark: CUDA and OpenCL SVM training benchmark

Most viewed papers (last 30 days)

Featured events

International Conference on Intelligent Autonomous Systems (ICIAS), 2018

International Conference on Robotics and Intelligent System (ICRIS), 2018

International Conference on Image and Graphics Processing (ICIGP), 2018

8th International Conference on Bioscience, Biochemistry and Bioinformatics (ICBBB), 2018

The 10th International Conference on Computer Modeling and Simulation (ICCMS), 2018