high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia Tesla GP100

Workload-aware Automatic Parallelization for Multi-GPU DNN Training

Sungho Shin, Youngmin Jo, Jungwook Choi, Swagath Venkataramani, Vijayalakshmi Srinivasan, Wonyong Sung

View

Tags: Artificial intelligence, Computer science, Deep learning, Neural networks, nVidia, nVidia DGX-1, nVidia GeForce GTX Titan XP, nVidia Tesla GP100

November 11, 2018 by hgpu

DLIO Benchmark

DLIO: A Data-Centric Benchmark for Scientific Deep Learning Applications

kEDM: A Performance-portable Implementation of Empirical Dynamic Modeling using Kokkos

cuSZ: CUDA-Based Error-Bounded Lossy Compressor for Scientific Data

cuSZ(x): Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

TornadoVM

Automatically Exploiting the Memory Hierarchy of GPUs through Just-in-Time Compilation

Floyd-Warshall function of this implementation for Intel Xeon Phi Knights Landing

Comparison of HPC Architectures for Computing All-Pairs Shortest Paths. Intel Xeon Phi KNL vs NVIDIA Pascal

NPBench: A Benchmarking Suite for High-Performance NumPy

* * *

2021

April

27-29

Munich, Germany

9th International Workshop on OpenCL and SYCL, 2021

2020

December

10-14

Virtually in Barcelona, Spain

The 18th International Conference on High Performance Computing & Simulation (HPCS), 2020

2020

November

24-27

Naha, Okinawa, Japan

The Fifth International Workshop on GPU Computing and AI (GCA), 2020

2021

January

13-15

Shenzhen, China

2nd International Conference on Frontiers of Intelligent Manufacturing and Automation (CFIMA’21), 2021

2020

December

14-16

Bangkok, Thailand

International Conference on Cyber Physical Systems and IoT (CPSIOT’20), 2020

Add event

See all events

high performance computing on graphics processing units: hgpu.org

Workload-aware Automatic Parallelization for Multi-GPU DNN Training

Recent source codes

DLIO Benchmark

kEDM: A Performance-portable Implementation of Empirical Dynamic Modeling using Kokkos

cuSZ: CUDA-Based Error-Bounded Lossy Compressor for Scientific Data

TornadoVM

Floyd-Warshall function of this implementation for Intel Xeon Phi Knights Landing

NPBench: A Benchmarking Suite for High-Performance NumPy

PeriPy - A High Performance OpenCL Peridynamics Package

PoCL: Portable Computing Language

Voxar MPS: Fluid simulation framework based on the MPS method

Easy and Efficient Transformer: Scalable Inference Solution For large NLP mode

Most viewed papers (last 30 days)

Featured events

9th International Workshop on OpenCL and SYCL, 2021

The 18th International Conference on High Performance Computing & Simulation (HPCS), 2020

The Fifth International Workshop on GPU Computing and AI (GCA), 2020

2nd International Conference on Frontiers of Intelligent Manufacturing and Automation (CFIMA’21), 2021

International Conference on Cyber Physical Systems and IoT (CPSIOT’20), 2020