high performance computing on graphics processing units: hgpu.org

hgpu.org » NLP

Efficient Large-Scale Language Model Training on GPU Clusters

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning

Yuhan Liu, Saurabh Agarwal, Shivaram Venkataraman

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia A100, Package, Python, Tesla P100

February 7, 2021 by hgpu

NaturalCC: A Toolkit to Naturalize the Source Code Corpus

Yao Wan, Yang He, Jian-Guo Zhang, Yulei Sui, Hai Jin, Guandong Xu, Caiming Xiong, Philip S. Yu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, Package, Programming Languages, Python, Video

December 13, 2020 by hgpu

TopicBERT for Energy Efficient Document Classification

Yatin Chaudhary, Pankaj Gupta, Khushbu Saxena, Vivek Kulkarni, Thomas Runkler, Hinrich Schütze

View

Download (PDF)

Tags: classification, Computer science, CUDA, Deep learning, NLP, nVidia, Tesla T4

November 8, 2020 by hgpu

Efficient Inference For Neural Machine Translation

Yi-Te Hsu, Sarthak Garg, Yi-Hsiu Liao, Ilya Chatsviorkin

View

Download (PDF)

Tags: Computer science, NLP, nVidia, Tesla V100

October 11, 2020 by hgpu

Applications of Deep Neural Networks

Jeff Heaton

View

Download (PDF)

Source codes

Tags: Book, Computer science, Computer vision, Deep learning, Neural networks, NLP, Package, Python, Security

September 20, 2020 by hgpu

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

Yuhao Zhang, Yuhui Zhang, Peng Qi, Christopher D. Manning, Curtis P. Langlotz

View

Download (PDF)

Source codes

Tags: Deep learning, Medicine, NLP, nVidia, nVidia Titan RTX, Package, Python

August 2, 2020 by hgpu

Character-level Transformer-based Neural Machine Translation

Nikolay Banar, Walter Daelemans, Mike Kestemont

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, nVidia GeForce GTX 1080 Ti

May 31, 2020 by hgpu

BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages

Abhishek Shivkumar, Jack Weston, Raphael Lenain, Emil Fristed

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, Medicine, NLP, Package, Python

May 24, 2020 by hgpu

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

View

Download (PDF)

Source codes

Tags: Computer science, NLP, nVidia, Package, Tesla V100, TPU

March 29, 2020 by hgpu

From English To Foreign Languages: Transferring Pre-trained Language Models

Ke Tran

View

Download (PDF)

Tags: Computer science, NLP, nVidia, Tesla V100

February 23, 2020 by hgpu

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement

Aliakbar Panahi, Seyran Saeedi, Tom Arodz

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, Tesla V100

November 17, 2019 by hgpu

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers

OpenMC Monte Carlo Code

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

Polygeist: C/C++ frontend for MLIR

Retargeting and Respecializing GPU Workloads for Performance Portability

Parallel Gaussian process with kernel approximation in CUDA

Optical flow algorithms for SYCL

SYCL in the edge: performance and energy evaluation for heterogeneous acceleration

OpenMP5-Offload-OpenMC-Intel-PVC

Distributed OpenMP Offloading of OpenMC on Intel GPU MAX Accelerators

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Efficient Large-Scale Language Model Training on GPU Clusters

AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning

NaturalCC: A Toolkit to Naturalize the Source Code Corpus

TopicBERT for Energy Efficient Document Classification

Efficient Inference For Neural Machine Translation

Applications of Deep Neural Networks

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

Character-level Transformer-based Neural Machine Translation

BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

From English To Foreign Languages: Transferring Pre-trained Language Models

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement

Recent source codes

QArray

Celerity: High-level C++ for Accelerator Clusters

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

OpenMC Monte Carlo Code

Polygeist: C/C++ frontend for MLIR

Parallel Gaussian process with kernel approximation in CUDA

Optical flow algorithms for SYCL

OpenMP5-Offload-OpenMC-Intel-PVC

Most viewed papers (last 30 days)