high performance computing on graphics processing units: hgpu.org

hgpu.org » OpenMPI

Enhancing Code Portability, Problem Scale, and Storage Efficiency in Exascale Applicationsin Exascale Applications

Nigel Tan

View

Tags: AMD Radeon Vega VII, ATI, Computer science, CUDA, Heterogeneous systems, HPC, nVidia, nVidia A100, nVidia DGX-A100, nVidia Quadro RTX 5000, OpenMP, OpenMPI, Particle-in-cell methods, performance portability, Tesla V100, Thesis

September 15, 2024 by hgpu

Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing

Yizhou Luo, Qiang Wang, Shaohuai Shi, Jiaxin Lai, Shuhan Qi, Jiajia Zhang, Xuan Wang

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, nVidia, nVidia GeForce RTX 2080 Ti, OpenMPI, PyTorch, Task scheduling

August 4, 2024 by hgpu

Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

Xinzhe Wu, Edoardo Di Napoli

View

Download (PDF)

Source codes

Tags: Algorithm optimization, Computer science, CUDA, MPI, nVidia, nVidia A100, OpenMP, OpenMPI, Package

October 8, 2023 by hgpu

StreamBrain: An HPC Framework for Brain-like Neural Networks on CPUs, GPUs and FPGAs

Artur Podobas, Martin Svedin, Steven W. D. Chien, Ivy B. Peng, Naresh Balaji Ravichandran, Pawel Herman, Anders Lansner, Stefano Markidis

View

Download (PDF)

Source codes

Tags: Bayesian, Computer science, CUDA, Deep learning, FPGA, HPC, Machine learning, MPI, nVidia, OpenMPI, Package, Tesla A100, Tesla V100

June 20, 2021 by hgpu

OpenSBLI: Automated code-generation for heterogeneous computing architectures applied to compressible fluid dynamics on structured grids

David J. Lusher, Satya P. Jammy, Neil D. Sandham

View

Download (PDF)

Source codes

Tags: cfd, Code generation, CUDA, Fluid dynamics, GPU cluster, Heterogeneous systems, Numerical simulation, nVidia, OpenCL, OpenMP, OpenMPI, Package, Python, Tesla P100

August 2, 2020 by hgpu

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David Kung, Michael Picheny

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, OpenMPI, Speech recognition, Tesla V100

July 21, 2019 by hgpu

Distributed Deep Learning Strategies For Automatic Speech Recognition

Wei Zhang, Xiaodong Cui, Ulrich Finkler, Brian Kingsbury, George Saon, David Kung, Michael Picheny

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, LSTM, Machine learning, nVidia, OpenMPI, Speech recognition, Tesla P100

April 14, 2019 by hgpu

swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

Jiarui Fang, Liandeng Li, Haohuan Fu, Jinlei Jiang, Wenlai Zhao, Conghui He, Xin You, Guangwen Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Neural networks, nVidia, OpenMPI, Package, Tesla K40

March 24, 2019 by hgpu

TensorFlow Doing HPC

Steven W. D. Chien, Stefano Markidis, Vyacheslav Olshevsky, Yaroslav Bulatov, Erwin Laure, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Deep learning, FFT, Heterogeneous systems, HPC, Machine learning, nVidia, nVidia Quadro K420, OpenMPI, Package, Performance, Python, TensorFlow, Tesla K80, Tesla V100

March 17, 2019 by hgpu

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

Peng Sun, Wansen Feng, Ruobing Han, Shengen Yan, Yonggang Wen

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, Neural networks, nVidia, OpenMPI, Performance, Tesla P100, Tesla V100

February 24, 2019 by hgpu

Direct N-body code on low-power embedded ARM GPUs

David Goz, Sara Bertocco, Luca Tornatore, Giuliano Taffoni

View

Download (PDF)

Tags: ARM, Astrophysics, FPGA, Heterogeneous systems, Instrumentation and Methods for Astrophysics, N-body simulation, OpenCL, OpenMPI, SoC

January 27, 2019 by hgpu

Parallax: Automatic Data-Parallel Training of Deep Neural Networks

Soojeong Kim, Gyeong-In Yu, Hojin Park, Sungwoo Cho, Eunji Jeong, Hyeonmin Ha, Sanha Lee, Joo Seong Jeong, Byung-Gon Chun

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX Titan XP, OpenMPI, Package

August 11, 2018 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Enhancing Code Portability, Problem Scale, and Storage Efficiency in Exascale Applicationsin Exascale Applications

Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing

Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

StreamBrain: An HPC Framework for Brain-like Neural Networks on CPUs, GPUs and FPGAs

OpenSBLI: Automated code-generation for heterogeneous computing architectures applied to compressible fluid dynamics on structured grids

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Distributed Deep Learning Strategies For Automatic Speech Recognition

swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

TensorFlow Doing HPC

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

Direct N-body code on low-power embedded ARM GPUs

Parallax: Automatic Data-Parallel Training of Deep Neural Networks

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)