high performance computing on graphics processing units: hgpu.org

hgpu.org » NLP

From English To Foreign Languages: Transferring Pre-trained Language Models

Ke Tran

View

Download (PDF)

Tags: Computer science, NLP, nVidia, Tesla V100

February 23, 2020 by hgpu

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement

Aliakbar Panahi, Seyran Saeedi, Tom Arodz

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, Tesla V100

November 17, 2019 by hgpu

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Deep learning, NLP, TPU

September 29, 2019 by hgpu

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow

Xuezhe Ma, Chunting Zhou, Xian Li, Graham Neubig, Eduard Hovy

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce GTX Titan X, Package

September 8, 2019 by hgpu

GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition

Hui Chen, Zijia Lin, Guiguang Ding, Jianguang Lou, Yusen Zhang, Borje Karlsson

View

Download (PDF)

Tags: Computer science, Neural networks, NLP, nVidia, Tesla P100

July 21, 2019 by hgpu

Semantic Product Search

Priyanka Nigam, Yiwei Song, Vijai Mohan, Vihan Lakshman, Weitian (Allen)Ding, Ankit Shingavi, Choon Hui Teo, Hao Gu, Bing Yin

View

Download (PDF)

Tags: Computer science, Deep learning, Hashing, NLP, nVidia, Tesla V100

July 4, 2019 by hgpu

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

Yihui Ren, Shinjae Yoo, Adolfy Hoisie

View

Download (PDF)

Tags: Cloud, Computer science, Computer vision, CUDA, Deep learning, Machine learning, NLP, nVidia, nVidia DGX-2, nVidia GeForce RTX 2080 Ti, Performance, Tesla V100

May 23, 2019 by hgpu

A Case Study: Exploiting Neural Machine Translation to Translate CUDA to OpenCL

Yonghae Kim, Hyesoon Kim

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, OpenCL

May 23, 2019 by hgpu

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, NLP, nVidia, Package, PyTorch, Video

April 7, 2019 by hgpu

Evaluating the Efficiency of CPUs, GPUs and FPGAs on a Near-Duplicate Document Detection Via OpenCL

Ercan Canhasi

View

Download (PDF)

Tags: Computer science, FPGA, Machine learning, NLP, OpenCL

July 5, 2018 by hgpu

Neural Code Comprehension: A Learnable Representation of Code Semantics

Tal Ben-Nun, Alice Shoshana Jakobovits, Torsten Hoefler

View

Download (PDF)

Tags: ATI, ATI Radeon HD 7970, Code generation, Computer science, CUDA, Deep learning, LLVM, LSTM, Machine learning, NLP, nVidia, nVidia GeForce GTX 970, OpenCL, Programming Languages, RNN

June 20, 2018 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

From English To Foreign Languages: Transferring Pre-trained Language Models

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow

GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition

Semantic Product Search

A Case Study: Exploiting Neural Machine Translation to Translate CUDA to OpenCL

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Evaluating the Efficiency of CPUs, GPUs and FPGAs on a Near-Duplicate Document Detection Via OpenCL

Neural Code Comprehension: A Learnable Representation of Code Semantics

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)