high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia DGX-2

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

Yihui Ren, Shinjae Yoo, Adolfy Hoisie

View

Tags: Cloud, Computer science, Computer vision, CUDA, Deep learning, Machine learning, NLP, nVidia, nVidia DGX-2, nVidia GeForce RTX 2080 Ti, Performance, Tesla V100

May 23, 2019 by hgpu

Hierarchical Product Quantization for Approximate Nearest Neighbors Search

Accelerated Approximate Nearest Neighbors Search Through Hierarchical Product Quantization

hlslib: A collection of extensions for Vivado HLS and Intel FPGA OpenCL to improve developer quality of life

hlslib: Software Engineering for Hardware Design

Taichi: A Language for High-Performance Computation on Spatially Sparse Data Structures

Taichi: A Language for High-Performance Computation on Spatially Sparse Data Structures

MCL kernel verification library

Verification of GPU Program Optimizations in Lean

waLBerla: A block-structured high-performance framework for multiphysics simulations

waLBerla: A block-structured high-performance framework for multiphysics simulations

MIOpen: AMD's Machine Intelligence Library

MIOpen: An Open Source Library For Deep Learning Primitives

horovod: Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet

Exascale Deep Learning for Scientific Inverse Problems

Futhark Vulkan Backend

Futhark Vulkan Backend

Megatron-LM: Ongoing research training transformer language models at scale, including: BERT & GPT-2

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Espresso: A Fast End-to-End Neural Speech Recognition Toolkit

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

See all packages

* * *

* * *

2019

May

13-15

Boston, USA

7th International Workshop on OpenCL, 2019

2019

May

13

Boston, MA, USA

Distributed Heterogeneous Programming in C/C++ (DHPCC++), 2019

2019

May

14

Larnaca, Cyprus

3rd International Workshop on Theoretical Approaches to Performance Evaluation, Modeling and Simulation (TAPEMS), 2019

2019

July

26-28

Rome, Italy

International Conference on Frontiers of Neural Networks (ICFNN), 2019

2019

July

26-28

Rome, Italy

International Conference on Frontiers of Artificial Intelligence and Machine Learning (FAIML), 2019

+

HGPU group © 2010-2019 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: