high performance computing on graphics processing units: hgpu.org

hgpu.org » NLP

Cramming: Training a Language Model on a Single GPU in One Day

Jonas Geiping, Tom Goldstein

View

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A4000, nVidia RTX A6000, Package

January 8, 2023 by hgpu

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

View

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, NLP, nVidia, nVidia A100, Package

September 11, 2022 by hgpu

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Petros Vavaroutsos, Ioannis Oroutzoglou, Dimosthenis Masouros, Dimitrios Soudris

View

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX 970, OpenCL

September 4, 2022 by hgpu

Long Code for Code Search

Fan Hu, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Xirong Li

View

Tags: Computer science, Deep learning, NLP, nVidia, Software Engineering, Tesla V100

August 28, 2022 by hgpu

MapReduce for Counting Word Frequencies with MPI and GPUs

Nithin Kavi

View

Tags: Algorithms, Computer science, CUDA, Julia, MapReduce, MPI, NLP, nVidia, Optimization, Package, Tesla V100

June 19, 2022 by hgpu

Lossless Acceleration for Seq2seq Generation with Aggressive Decoding

Tao Ge, Heming Xia, Xin Sun, Si-Qing Chen, Furu Wei

View

Tags: Computer science, CUDA, Machine learning, NLP, nVidia, Package, Tesla V100

May 29, 2022 by hgpu

The Ecological Footprint of Neural Machine Translation Systems

Dimitar Sherionov, Eva Vanmassenhove

View

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, nVidia GeForce GTX 1080 Ti, Package, Tesla P100

February 13, 2022 by hgpu

Autotuning CUDA: Applying NLP Techniques to LS-CAT

Lars Bjertnes, Jacob O. Tørring, Anne C. Elster

View

Tags: Auto-Tuning, Computer science, CUDA, Machine learning, NLP, nVidia

December 5, 2021 by hgpu

Small-Bench NLP: Benchmark for small single GPU trained models in Natural Language Processing

Kamal Raj Kanakarajan, Bhuvana Kundumani, Malaikannan Sankarasubbu

View

Tags: Benchmarking, Computer science, NLP

September 26, 2021 by hgpu

Easy and Efficient Transformer: Scalable Inference Solution For large NLP mode

Gongzheng li, Yadong Xi, Jingzhen Ding, Duan Wang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao

View

Tags: Computer science, CUDA, NLP, nVidia, nVidia GeForce RTX 2080 Ti, Package, Tesla A100

May 2, 2021 by hgpu

How to Train BERT with an Academic Budget

Peter Izsak, Moshe Berchansky, Omer Levy

View

Tags: Artificial intelligence, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX Titan V, Tesla V100

April 25, 2021 by hgpu

Efficient Large-Scale Language Model Training on GPU Clusters

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

Genomics-GPU: A Benchmark Suite for GPU-accelerated Genome Analysis

Genomics-GPU: A Benchmark Suite for GPU-accelerated Genome Analysis

AutoDock for GPUs and other accelerators

Experiences Migrating CUDA to SYCL: A Molecular Docking Case Study

spotPython: Sequential Parameter Optimization in Python

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

Test benchmarks for CELERITY

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Beehive SPIR-V Toolkit

Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

TorchBench: a collection of open source benchmarks used to evaluate PyTorch performance

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Prediction of Performance and Power Consumption of GPGPU Applications

Prediction of Performance and Power Consumption of GPGPU Applications

Descend: an attempt at safe imperative GPU programming

Descend: A Safe GPU Systems Programming Language

Redwood heterogeneous framework

Redwood: Flexible and Portable Heterogeneous Tree Traversal Workloads

See all packages

* * *

* * *

HGPU group © 2010-2023 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: