high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

Automatic Kernel Generation for Volta Tensor Cores

Somashekaracharya G. Bhaskaracharya, Julien Demouth, Vinod Grover

View

Tags: Compilers, Computer science, CUBLAS, CUDA, Deep learning, Matrix multiplication, nVidia, nVidia Quadro GV100, Performance, Programming Languages, PTX

June 28, 2020 by hgpu

Unsupervised Deep Learning of Incompressible Fluid Dynamics

Nils Wandel, Michael Weinmann, Reinhard Klein

View

Download (PDF)

Tags: Deep learning, Differential equations, Fluid dynamics, Fluid simulation, Neural networks, nVidia, nVidia GeForce GTX 2080 Ti, Partial differential equations, PDEs, PyTorch

June 21, 2020 by hgpu

Ansor: Generating High-Performance Tensor Programs for Deep Learning

Lianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu, Cody Hao Yu, Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, Joseph E. Gonzalez, Ion Stoica

View

Download (PDF)

Tags: ARM, Compilers, Computer science, CUDA, Deep learning, Neural networks, nVidia, Optimization, Search strategies, Tesla V100

June 21, 2020 by hgpu

Neural Architecture Search without Training

Joseph Mellor, Jack Turner, Amos Storkey, Elliot J. Crowley

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 1080 Ti, Package

June 14, 2020 by hgpu

Character-level Transformer-based Neural Machine Translation

Nikolay Banar, Walter Daelemans, Mike Kestemont

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, nVidia GeForce GTX 1080 Ti

May 31, 2020 by hgpu

Brief Announcement: On the Limits of Parallelizing Convolutional Neural Networks on GPUs

Behnam Pourghassemi, Chenghao Zhang, Joo Hwan Lee, Aparna Chandramowlishwaran

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, TensorFlow, Tesla K40

May 31, 2020 by hgpu

HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism

Jay H. Park, Gyeongchan Yun, Chang M. Yi, Nguyen T. Nguyen, Seungmin Lee, Jaesik Choi, Sam H. Noh, Young-ri Choi

View

Download (PDF)

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX Titan V, nVidia GeForce RTX 2060, nVidia Quadro P 4000, nVidia Titan RTX

May 31, 2020 by hgpu

HaoCL: Harnessing Large-scale Heterogeneous Processors Made Easy

Yao Chen, Xin Long, Jiong He, Yuhang Chen, Hongshi Tan, Zhenxiang Zhang, Marianne Winslett, Deming Chen

View

Download (PDF)

Tags: Computer science, Deep learning, FPGA, Heterogeneous systems, Machine learning, nVidia, OpenCL, Tesla P4

May 24, 2020 by hgpu

Literature Review and Implementation Overview: High Performance Computing with Graphics Processing Units for Classroom and Research Use

Nathan George

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Education, GPU cluster, HPC, nVidia, nVidia GeForce GTX 1080 Ti, nVidia Quadro RTX 5000, Overview

May 24, 2020 by hgpu

BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages

Abhishek Shivkumar, Jack Weston, Raphael Lenain, Emil Fristed

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Machine learning, Medicine, NLP, Package, Python

May 24, 2020 by hgpu

Deep Learning with GO

Derek L. Stinson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Go, nVidia, nVidia GeForce GTX 1080 Ti, Package, Thesis

May 17, 2020 by hgpu

Importance of Data Loading Pipeline in Training Deep Neural Networks

Mahdi Zolnouri, Xinlin Li, Vahid Partovi Nia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce GTX Titan, Package, Tesla V100

May 10, 2020 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Automatic Kernel Generation for Volta Tensor Cores

Unsupervised Deep Learning of Incompressible Fluid Dynamics

Ansor: Generating High-Performance Tensor Programs for Deep Learning

Neural Architecture Search without Training

Character-level Transformer-based Neural Machine Translation

Brief Announcement: On the Limits of Parallelizing Convolutional Neural Networks on GPUs

HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism

HaoCL: Harnessing Large-scale Heterogeneous Processors Made Easy

Literature Review and Implementation Overview: High Performance Computing with Graphics Processing Units for Classroom and Research Use

BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages

Deep Learning with GO

Importance of Data Loading Pipeline in Training Deep Neural Networks

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)