high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Exascale Deep Learning for Scientific Inverse Problems

Nouamane Laanait, Joshua Romero, Junqi Yin, M. Todd Young, Sean Treichler, Vitalii Starchenko, Albina Borisevich, Alex Sergeev, Michael Matheson

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Neural networks, nVidia, Package, Tesla V100

September 29, 2019 by hgpu

Futhark Vulkan Backend

Steffen Holst Larsen

View

Download (PDF)

Source codes

Tags: Computer science, nVidia, nVidia GeForce GTX 780 Ti, OpenCL, Package, Vulkan

September 29, 2019 by hgpu

Heterogeneous Resource-Elastic Management for FPGAs: Concepts, Theory and Implementation

Anuj Vaishnav, Dirk Koch, Khoa Dang Pham

View

Download (PDF)

Tags: Computer science, FPGA, Heterogeneous systems, HLS, OpenCL

September 29, 2019 by hgpu

Elastic deep learning in multi-tenant GPU cluster

Yidi Wu, Kaihao Ma, Xiao Yan, Zhi Liu, James Cheng

View

Download (PDF)

Tags: Computer science, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia GeForce GTX 1080 Ti, Tesla V100

September 29, 2019 by hgpu

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Deep learning, NLP, TPU

September 29, 2019 by hgpu

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu

View

Download (PDF)

Tags: AI, AMD Radeon R7, ATI, Computer science, Deep learning, Neural networks, nVidia, PyTorch, TensorFlow, Tesla P100, Tesla V100, TPU

September 22, 2019 by hgpu

ALPyNA: Acceleration of Loops in Python for Novel Architectures

Dejice Jacob, Jeremy Singer

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, nVidia, nVidia GeForce GTX 1060, Python

September 22, 2019 by hgpu

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

Yiming Wang, Tongfei Chen, Hainan Xu, Shuoyang Ding, Hang Lv, Yiwen Shao, Nanyun Peng, Lei Xie, Shinji Watanabe, Sanjeev Khudanpur

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1080 Ti, Package, Speech recognition

September 22, 2019 by hgpu

Code optimization based on source to source transformations using profile guided metrics

Youenn Lebras

View

Download (PDF)

Tags: Code generation, Computer science, Performance, Thesis

September 15, 2019 by hgpu

Parallelizing Multiple Flow Accumulation Algorithm using CUDA and OpenACC

Natalija Stojanovic, Dragan Stojanovic

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, nVidia, OpenACC, Package, Tesla K80

September 15, 2019 by hgpu

Characterizing and Predicting Scientific Workloads for Heterogeneous Computing Systems

Beau Johnston

View

Download (PDF)

Source codes

Tags: Algorithms, AMD Radeon RX 480, ATI Radeon HD 7970, Benchmarking, Computer science, FPGA, Heterogeneous systems, Intel Xeon Phi, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, Tesla K20, Tesla K40, Thesis

September 15, 2019 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Exascale Deep Learning for Scientific Inverse Problems

Futhark Vulkan Backend

Heterogeneous Resource-Elastic Management for FPGAs: Concepts, Theory and Implementation

Elastic deep learning in multi-tenant GPU cluster

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

ALPyNA: Acceleration of Loops in Python for Novel Architectures

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

Code optimization based on source to source transformations using profile guided metrics

Parallelizing Multiple Flow Accumulation Algorithm using CUDA and OpenACC

Characterizing and Predicting Scientific Workloads for Heterogeneous Computing Systems

Recent source codes

gpuPairHMM: Ultra-fast GPU-based PairHMM for DNA Variant Calling

Gaia AVU-GSR

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Most viewed papers (last 30 days)