high performance computing on graphics processing units: hgpu.org

hgpu.org » NLP

Easy and Efficient Transformer: Scalable Inference Solution For large NLP mode

Gongzheng li, Yadong Xi, Jingzhen Ding, Duan Wang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, NLP, nVidia, nVidia GeForce RTX 2080 Ti, Package, Tesla A100

May 2, 2021 by hgpu

How to Train BERT with an Academic Budget

Peter Izsak, Moshe Berchansky, Omer Levy

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX Titan V, Tesla V100

April 25, 2021 by hgpu

Efficient Large-Scale Language Model Training on GPU Clusters

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning

Yuhan Liu, Saurabh Agarwal, Shivaram Venkataraman

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia A100, Package, Python, Tesla P100

February 7, 2021 by hgpu

NaturalCC: A Toolkit to Naturalize the Source Code Corpus

Yao Wan, Yang He, Jian-Guo Zhang, Yulei Sui, Hai Jin, Guandong Xu, Caiming Xiong, Philip S. Yu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, Package, Programming Languages, Python, Video

December 13, 2020 by hgpu

TopicBERT for Energy Efficient Document Classification

Yatin Chaudhary, Pankaj Gupta, Khushbu Saxena, Vivek Kulkarni, Thomas Runkler, Hinrich Schütze

View

Download (PDF)

Tags: classification, Computer science, CUDA, Deep learning, NLP, nVidia, Tesla T4

November 8, 2020 by hgpu

Efficient Inference For Neural Machine Translation

Yi-Te Hsu, Sarthak Garg, Yi-Hsiu Liao, Ilya Chatsviorkin

View

Download (PDF)

Tags: Computer science, NLP, nVidia, Tesla V100

October 11, 2020 by hgpu

Applications of Deep Neural Networks

Jeff Heaton

View

Download (PDF)

Source codes

Tags: Book, Computer science, Computer vision, Deep learning, Neural networks, NLP, Package, Python, Security

September 20, 2020 by hgpu

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

Yuhao Zhang, Yuhui Zhang, Peng Qi, Christopher D. Manning, Curtis P. Langlotz

View

Download (PDF)

Source codes

Tags: Deep learning, Medicine, NLP, nVidia, nVidia Titan RTX, Package, Python

August 2, 2020 by hgpu

Character-level Transformer-based Neural Machine Translation

Nikolay Banar, Walter Daelemans, Mike Kestemont

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, nVidia GeForce GTX 1080 Ti

May 31, 2020 by hgpu

BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages

Abhishek Shivkumar, Jack Weston, Raphael Lenain, Emil Fristed

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, Medicine, NLP, Package, Python

May 24, 2020 by hgpu

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

View

Download (PDF)

Source codes

Tags: Computer science, NLP, nVidia, Package, Tesla V100, TPU

March 29, 2020 by hgpu

DLIO Benchmark

DLIO: A Data-Centric Benchmark for Scientific Deep Learning Applications

kEDM: A Performance-portable Implementation of Empirical Dynamic Modeling using Kokkos

cuSZ: CUDA-Based Error-Bounded Lossy Compressor for Scientific Data

cuSZ(x): Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

TornadoVM

Automatically Exploiting the Memory Hierarchy of GPUs through Just-in-Time Compilation

Floyd-Warshall function of this implementation for Intel Xeon Phi Knights Landing

Comparison of HPC Architectures for Computing All-Pairs Shortest Paths. Intel Xeon Phi KNL vs NVIDIA Pascal

NPBench: A Benchmarking Suite for High-Performance NumPy

* * *

2021

April

27-29

Munich, Germany

9th International Workshop on OpenCL and SYCL, 2021

2020

December

10-14

Virtually in Barcelona, Spain

The 18th International Conference on High Performance Computing & Simulation (HPCS), 2020

2020

November

24-27

Naha, Okinawa, Japan

The Fifth International Workshop on GPU Computing and AI (GCA), 2020

2021

January

13-15

Shenzhen, China

2nd International Conference on Frontiers of Intelligent Manufacturing and Automation (CFIMA’21), 2021

2020

December

14-16

Bangkok, Thailand

International Conference on Cyber Physical Systems and IoT (CPSIOT’20), 2020

Add event

See all events

high performance computing on graphics processing units: hgpu.org

Easy and Efficient Transformer: Scalable Inference Solution For large NLP mode

How to Train BERT with an Academic Budget

Efficient Large-Scale Language Model Training on GPU Clusters

AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning

NaturalCC: A Toolkit to Naturalize the Source Code Corpus

TopicBERT for Energy Efficient Document Classification

Efficient Inference For Neural Machine Translation

Applications of Deep Neural Networks

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

Character-level Transformer-based Neural Machine Translation

BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Recent source codes

DLIO Benchmark

kEDM: A Performance-portable Implementation of Empirical Dynamic Modeling using Kokkos

cuSZ: CUDA-Based Error-Bounded Lossy Compressor for Scientific Data

TornadoVM

Floyd-Warshall function of this implementation for Intel Xeon Phi Knights Landing

NPBench: A Benchmarking Suite for High-Performance NumPy

PeriPy - A High Performance OpenCL Peridynamics Package

PoCL: Portable Computing Language

Voxar MPS: Fluid simulation framework based on the MPS method

Easy and Efficient Transformer: Scalable Inference Solution For large NLP mode

Most viewed papers (last 30 days)

Featured events

9th International Workshop on OpenCL and SYCL, 2021

The 18th International Conference on High Performance Computing & Simulation (HPCS), 2020

The Fifth International Workshop on GPU Computing and AI (GCA), 2020

2nd International Conference on Frontiers of Intelligent Manufacturing and Automation (CFIMA’21), 2021

International Conference on Cyber Physical Systems and IoT (CPSIOT’20), 2020