high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia DGX-1

Workload-aware Automatic Parallelization for Multi-GPU DNN Training

Sungho Shin, Youngmin Jo, Jungwook Choi, Swagath Venkataramani, Vijayalakshmi Srinivasan, Wonyong Sung

View

Tags: Artificial intelligence, Computer science, Deep learning, Neural networks, nVidia, nVidia DGX-1, nVidia GeForce GTX Titan XP, nVidia Tesla GP100

November 11, 2018 by hgpu

Synkhronos: a Multi-GPU Theano Extension for Data Parallelism

Adam Stooke, Pieter Abbeel

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, nVidia, nVidia DGX-1, Package, Tesla P100, Theano

October 15, 2017 by hgpu

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?

Ammar Ahmad Awan, Ching-Hsiang Chu, Hari Subramoni, Dhabaleswar K. Panda

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, MPI, nVidia, nVidia DGX-1, OpenMPI, Tesla V100

August 1, 2017 by hgpu

Optimizing Deep CNN-Based Queries over Video Streams at Scale

Daniel Kang, John Emmons, Firas Abuzaid, Peter Bailis, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, Computer vision, Databases, Deep learning, Machine learning, Neural networks, nVidia, nVidia DGX-1, Package, TensorFlow, Tesla P100

March 9, 2017 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Workload-aware Automatic Parallelization for Multi-GPU DNN Training

Synkhronos: a Multi-GPU Theano Extension for Data Parallelism

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?

Optimizing Deep CNN-Based Queries over Video Streams at Scale

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)