high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

FC_ACCEL: Enabling Efficient, Low-Latency and Flexible Inference in DNN Fully Connected Layers, using Optimized Checkerboard Block matrix decomposition, fast scheduling, and a resource efficient 1D PE array with a custom HBM2 memory subsystem

Nick Iliev, Amit R Trivedi

View

Tags: CNN, Computer science, Deep learning, FPGA, Matrix decomposition, Neural networks, nVidia, nVidia Jetson AGX Xavier, Performance

February 13, 2022 by hgpu

Performance prediction of deep learning applications training in GPU as a service systems

Marco Lattuada, Eugenio Gianniti, Danilo Ardagna, Li Zhang

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 1080 Ti, Performance, Tesla K80, Tesla M60

January 30, 2022 by hgpu

Building a Performance Model for Deep Learning Recommendation Model Training on GPUs

Zhongyi Lin, Louis Feng, Ehsan K. Ardestani, Jaewon Lee, John Lundell, Changkyu Kim, Arun Kejariwal, John D. Owens

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce GTX Titan XP, Package, Performance, Tesla P100, Tesla V100

January 23, 2022 by hgpu

Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment

Hulin Dai, Xuan Peng, Xuanhua Shi, Ligang He, Qian Xiong, Hai Jin

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, Neural networks, nVidia, Performance, PyTorch, TensorFlow, Tesla P100

January 9, 2022 by hgpu

CitiusSynapse: A Deep Learning Framework for Embedded Systems

Seungtae Hong, Hyunwoo Cho, Jeong-Si Kim

View

Download (PDF)

Tags: Computer science, Deep learning, Embedded high-performance computing, OpenCL

December 12, 2021 by hgpu

Manas: Mining Software Repositories to Assist AutoML

Giang Nguyen, Johir Islam, Rangeet Pan, Hridesh Rajan

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Neural networks, nVidia, Package, Python, Software Engineering, Tesla V100

December 12, 2021 by hgpu

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

Christopher Noel Hesse

View

Download (PDF)

Tags: Benchmarking, Computer science, Deep learning, FPGA, Neural networks, nVidia, nVidia DGX-1, nVidia GeForce RTX 2070, nVidia Jetson Nano, Performance, Tesla V100

December 5, 2021 by hgpu

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments

Ji Liu, Zhihua Wu, Dianhai Yu, Yanjun Ma, Danlei Feng, Minxu Zhang, Xinxuan Wu, Xuefeng Yao, Dejing Dou

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Distributed computing, Heterogeneous systems, Neural networks, nVidia, Package, Tesla V100

November 28, 2021 by hgpu

QGTC: Accelerating Quantized GNN via GPU Tensor Core

Yuke Wang, Boyuan Feng, Yufei Ding

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce RTX 3090, TPU

November 21, 2021 by hgpu

MQBench: Towards Reproducible and Deployable Model Quantization Benchmark

Yuhang Li, Mingzhu Shen, Jian Ma, Yan Ren, Mingxin Zhao, Qi Zhang, Ruihao Gong, Fengwei Yu, Junjie Yan

View

Download (PDF)

Source codes

Tags: Algorithms, ASIC, Benchmarking, Computer science, Deep learning, DSP, Package

November 14, 2021 by hgpu

Collage: Automated Integration of Deep Learning Backends

Byungsoo Jeon, Sunghyun Park, Peiyuan Liao, Sheng Xu, Tianqi Chen, Zhihao Jia

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 2070, Tesla V100

November 7, 2021 by hgpu

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

Zhengda Bian, Hongxin Liu, Boxiang Wang, Haichen Huang, Yongbin Li, Chuanrui Wang, Fan Cui, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, nVidia, Package, Tesla P100

October 31, 2021 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

FC_ACCEL: Enabling Efficient, Low-Latency and Flexible Inference in DNN Fully Connected Layers, using Optimized Checkerboard Block matrix decomposition, fast scheduling, and a resource efficient 1D PE array with a custom HBM2 memory subsystem

Performance prediction of deep learning applications training in GPU as a service systems

Building a Performance Model for Deep Learning Recommendation Model Training on GPUs

Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment

CitiusSynapse: A Deep Learning Framework for Embedded Systems

Manas: Mining Software Repositories to Assist AutoML

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments

QGTC: Accelerating Quantized GNN via GPU Tensor Core

MQBench: Towards Reproducible and Deployable Model Quantization Benchmark

Collage: Automated Integration of Deep Learning Backends

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)