high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Jinfan Chen, Shigang Li, Ran Gun, Jinhui Yuan, Torsten Hoefler

View

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia A100, Package, Tesla P100

January 22, 2023 by hgpu

Cramming: Training a Language Model on a Single GPU in One Day

Jonas Geiping, Tom Goldstein

View

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A4000, nVidia RTX A6000, Package

January 8, 2023 by hgpu

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

Jianhui Li, Zhennan Qin, Yijie Mei, Jingze Cui, Yunfei Song, Ciyong Chen, Yifei Zhang, Longsheng Du, Xianhang Cheng, Baihui Jin, Jason Ye, Eric Lin, Dan Lavery

View

Tags: Code generation, Compilers, Computer science, Deep learning, OpenCL, Package

January 8, 2023 by hgpu

Kernel-as-a-Service: A Serverless Interface to GPUs

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, Joseph Gonzalez

View

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, nVidia, Package, Tesla V100

December 25, 2022 by hgpu

A Study on the Intersection of GPU Utilization and CNN Inference

Jack Kosaian, Amar Phanishayee

View

Tags: CNN, Computer science, Deep learning, Neural networks, nVidia, Performance, Tesla V100

December 19, 2022 by hgpu

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

René Caspart, Sebastian Ziegler, Arvid Weyrauch, Holger Obermaier, Simon Raffeiner, Leon Pascal Schuhmacher, Jan Scholtyssek, Darya Trofimova, Marco Nolden, Ines Reinartz, Fabian Isensee, Markus Götz, Charlotte Debus

View

Tags: Artificial intelligence, Computer science, Deep learning, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Package

December 11, 2022 by hgpu

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

Mariko Tatsumi, Silviu-Ioan Filip, Caroline White, Olivier Sentieys, Guy Lemieux

View

Tags: Computer science, CUDA, Deep learning, FPGA, nVidia, Precision

December 11, 2022 by hgpu

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu

View

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, HPC, nVidia, PyTorch, Tesla V100

December 11, 2022 by hgpu

Fast convolution kernels on pascal GPU with high memory efficiency

Qiong Chang, Masaki Onishi, Tsutomu Maruyama

View

Tags: CNN, Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1080 Ti, Performance

December 4, 2022 by hgpu

Efficient Incremental Text-to-Speech on GPUs

Muyang Du, Chuan Liu, Jiaxing Qi, Junjie Lai

View

Tags: Computer science, Deep learning, Machine learning, nVidia, nVidia A10, Tesla V100

December 4, 2022 by hgpu

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

User-Driven Online Kernel Fusion for SYCL

Victor Perez, Lukas Sommer, Victor Lomüller, Kumudha Narasimhan, Mehdi Goli

View

Tags: Compilers, Computer science, Deep learning, OpenCL, Package, SYCL

November 27, 2022 by hgpu

* * *

FDAS: Fourier Domain Acceleration Search, FPGA-accelerated with OpenCL

Pulsar search acceleration using FPGAs and OpenCL templates

Implementation of a motion estimation algorithm for Intel FPGAs using OpenCL

Implementation of a motion estimation algorithm for Intel FPGAs using OpenCL

Reeber: a library for shared- and distributed-memory parallel computation of merge trees

Fast Merge Tree Computation via SYCL

pocl: Portable Computing Language

Efficient OpenCL system integration of non-blocking FPGA accelerators

OneFlow: a deep learning framework designed to be user-friendly, scalable and efficient

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Python Suite for Advanced General Ensemble Simulations

PySAGES: flexible, advanced sampling methods accelerated with GPUs

GPU load-balancing library for regular and irregular computations

A Programming Model for GPU Load Balancing

Shine compiler for the RISE language

A Domain-Extensible Compiler with Controllable Automation of Optimisations

Cramming the training of a (BERT-type) language model into limited compute

Cramming: Training a Language Model on a Single GPU in One Day

oneDNN: oneAPI Deep Neural Network Library

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

See all packages

* * *

* * *

HGPU group © 2010-2023 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: