high performance computing on graphics processing units: hgpu.org

hgpu.org » Tesla V100

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu

View

Download (PDF)

Tags: AI, AMD Radeon R7, ATI, Computer science, Deep learning, Neural networks, nVidia, PyTorch, TensorFlow, Tesla P100, Tesla V100, TPU

September 22, 2019 by hgpu

Model-Based Warp-Level Tiling for Image Processing Programs on GPUs

Abhinav Jangda, Arjun Guha

View

Download (PDF)

Tags: CUDA, Image procesing, nVidia, nVidia GeForce GTX 1080 Ti, Python, Tesla V100

September 22, 2019 by hgpu

Efficient Interleaved Batch Matrix Solvers for CUDA

Andrew Gloster, Enda Carroll, Miguel Bustamante, Lennon O'Naraigh

View

Download (PDF)

Source codes

Tags: Algorithms, Computational Physics, Computer science, CUDA, Matrix inversion, nVidia, Package, Tesla V100

September 15, 2019 by hgpu

Demystifying the MLPerf Benchmark Suite

Snehil Verma, Qinzhe Wu, Bagus Hanindhito, Gunjan Jha, Eugene B. John, Ramesh Radhakrishnan, Lizy K. John

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Deep learning, Machine learning, nVidia, Package, Tesla P100, Tesla V100

September 1, 2019 by hgpu

SODECL: An Open Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel

Eleftherios Avramidis, Marta Lalik, Ozgur E. Akman

View

Download (PDF)

Source codes

Tags: AMD FirePro W8100, ATI, Computer science, Differential equations, Mathematical Software, nVidia, OpenCL, Package, Tesla V100

August 18, 2019 by hgpu

Performance Comparison for Neuroscience Application Benchmarks

Andreas Herten, Thorsten Hater, Wouter Klijn, Dirk Pleiter

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Neuroscience, nVidia, Performance, Tesla P100, Tesla V100

August 11, 2019 by hgpu

GPU-Accelerated Atari Emulation for Reinforcement Learning

Steven Dalton, Iuri Frosio, Michael Garland

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce GTX Titan V, Package, Tesla V100

July 28, 2019 by hgpu

Benchmarking TPU, GPU, and CPU Platforms for Deep Learning

Yu (Emma)Wang, Gu-Yeon Wei, David Brooks

View

Download (PDF)

Tags: Benchmarking, Cloud, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, Performance, Tesla V100, TPU

July 28, 2019 by hgpu

A Versatile Software Systolic Execution Model for GPU Memory-Bound Kernels

Peng Chen, Mohamed Wahib, Shinichiro Takizawa, Ryousei Takano, Satoshi Matsuoka

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, Package, Stencil computation, Tesla P100, Tesla V100

July 21, 2019 by hgpu

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David Kung, Michael Picheny

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, OpenMPI, Speech recognition, Tesla V100

July 21, 2019 by hgpu

Profiling based Out-of-core Hybrid Method for Large Neural Networks

Yuki Ito, Haruki Imai, Tung Le Duc, Yasushi Negishi, Kiyokuni Kawachiya, Ryo Matsumiya, Toshio Endo

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, Performance, Tesla V100

July 14, 2019 by hgpu

GPU-Smash: Compression abstraction library

A Parallel Compression Pipeline for Improving GPU Virtualization Data Transfers

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

Exploring Scalability in C++ Parallel STL Implementations

Noarr Structures

Abstractions for C++ code optimizations in parallel high-performance applications

$3D-fractal-generators$

HiCCL: A hierarchical collective communications library with portable optimizations

HiCCL: A Hierarchical Collective Communication Library

GRAFX: An Open-Source Library for Audio Processing Graphs in PyTorch

In-browser Inference Measurement

Anatomizing Deep Learning Inference in Web Browsers

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Model-Based Warp-Level Tiling for Image Processing Programs on GPUs

Efficient Interleaved Batch Matrix Solvers for CUDA

Demystifying the MLPerf Benchmark Suite

SODECL: An Open Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel

Performance Comparison for Neuroscience Application Benchmarks

GPU-Accelerated Atari Emulation for Reinforcement Learning

A Versatile Software Systolic Execution Model for GPU Memory-Bound Kernels

A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition

Profiling based Out-of-core Hybrid Method for Large Neural Networks

Recent source codes

GPU-Smash: Compression abstraction library

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

Noarr Structures

3D-fractal-generators

SyncPerformance

VerCors: a verification toolset for verifying parallel and concurrent software

HiCCL: A hierarchical collective communications library with portable optimizations

GRAFX: An Open-Source Library for Audio Processing Graphs in PyTorch

In-browser Inference Measurement

Most viewed papers (last 30 days)