high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu

View

Download (PDF)

Tags: AI, AMD Radeon R7, ATI, Computer science, Deep learning, Neural networks, nVidia, PyTorch, TensorFlow, Tesla P100, Tesla V100, TPU

September 22, 2019 by hgpu

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

Yiming Wang, Tongfei Chen, Hainan Xu, Shuoyang Ding, Hang Lv, Yiwen Shao, Nanyun Peng, Lei Xie, Shinji Watanabe, Sanjeev Khudanpur

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1080 Ti, Package, Speech recognition

September 22, 2019 by hgpu

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow

Xuezhe Ma, Chunting Zhou, Xian Li, Graham Neubig, Eduard Hovy

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce GTX Titan X, Package

September 8, 2019 by hgpu

Compositional Deep Learning in Futhark

Duc Minh Tran, Troels Henriksen, Martin Elsman

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 2080 Ti, Package, TensorFlow

September 1, 2019 by hgpu

Demystifying the MLPerf Benchmark Suite

Snehil Verma, Qinzhe Wu, Bagus Hanindhito, Gunjan Jha, Eugene B. John, Ramesh Radhakrishnan, Lizy K. John

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Deep learning, Machine learning, nVidia, Package, Tesla P100, Tesla V100

September 1, 2019 by hgpu

Automated Architecture Design for Deep Neural Networks

Steven Abreu

View

Download (PDF)

Tags: Computer science, Deep learning, GPU cluster, Machine learning, Neural networks, nVidia, Tesla K80, Thesis

September 1, 2019 by hgpu

Automatic Compiler Based FPGA Accelerator for CNN Training

Shreyas Kolala Venkataramanaiah, Yufei Ma, Shihui Yin, Eriko Nurvithadhi, Aravind Dasu, Yu Cao, Jae-sun Seo

View

Download (PDF)

Tags: Code generation, Compilers, Computer science, Deep learning, FPGA, Neural networks

August 25, 2019 by hgpu

Survey paper on Deep Learning on GPUs

Sparsh Mittal, Shraiysh Vaishay

View

Download (PDF)

Tags: Deep learning, Paper, Research, survey

August 21, 2019 by sparsh0mittal

Mass Estimation from Images using Deep Neural Network and Sparse Ground Truth

Muhammad K.A. Hamdan, Diane Rover, John Just

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, Neural networks, Package

August 18, 2019 by hgpu

A Deep Learning Approach for Automatic Code Optimization in the Tiramisu Compiler

Mohammed Henni, Ilhem Isra Mekki

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia DGX-1

August 11, 2019 by hgpu

A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing

Mario P. Vestias

View

Download (PDF)

Tags: CNN, Computer science, Deep learning, FPGA, Neural networks

August 5, 2019 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow

Compositional Deep Learning in Futhark

Demystifying the MLPerf Benchmark Suite

Automated Architecture Design for Deep Neural Networks

Automatic Compiler Based FPGA Accelerator for CNN Training

Survey paper on Deep Learning on GPUs

Mass Estimation from Images using Deep Neural Network and Sparse Ground Truth

A Deep Learning Approach for Automatic Code Optimization in the Tiramisu Compiler

A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)