high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

Deep Learning Models on CPUs: A Methodology for Efficient Training

Quchen Fu, Ramesh Chukka, Keith Achorn, Thomas Atta-fosu, Deepak R. Canchi, Zhongwei Teng, Jules White, Douglas C. Schmidt

View

Download (PDF)

Tags: Computer science, Deep learning, Performance, PyTorch, Visualization

June 26, 2022 by hgpu

CoDL: Efficient CPU-GPU Co-execution for Deep Learning Inference on Mobile Devices

Fucheng Jia, Deyu Zhang, Ting Cao, Shiqi Jiang, Yunxin Liu, Ju Ren, Yaoxue Zhang

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Heterogeneous systems, Package, Performance

June 19, 2022 by hgpu

Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml

Nicolò Ghielmetti, Vladimir Loncar, Maurizio Pierini, Marcel Roed, Sioni Summers, Thea Aarrestad, Christoffer Petersson, Hampus Linander, Jennifer Ngadiuba, Kelvin Lin, Philip Harris

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, FPGA, Heterogeneous systems, HLS, Machine learning, Neural networks, Package

May 22, 2022 by hgpu

GPUNet: Searching the Deployable Convolution Neural Networks for GPUs

Linnan Wang, Chenhan Yu, Satish Salian, Slawomir Kierat, Szymon Migacz, Alex Fit Florea

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia Quadro GV100, Performance, Tesla A100

May 8, 2022 by hgpu

One-shot tuner for deep learning compilers

Jaehun Ryu, Eunhyeok Park, Hyojin Sung

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 2080 Ti, Package

March 27, 2022 by hgpu

Enabling On-Device Smartphone GPU based Training: Lessons Learned

Anish Das, Young D. Kwon, Jagmohan Chauhan, Cecilia Mascolo

View

Download (PDF)

Tags: Computer science, Deep learning, Neural networks, OpenCL

March 6, 2022 by hgpu

A Comprehensive Benchmark of Deep Learning Libraries on Mobile Devices

Qiyang Zhang, Xiang Li, Xiangying Che, Xiao Ma, Ao Zhou, Mengwei Xu, Shangguang Wang, Yun Ma, Xuanzhe Liu

View

Download (PDF)

Source codes

Tags: ARM, Benchmarking, Computer science, Deep learning, OpenCL, OpenGL, Vulkan

February 20, 2022 by hgpu

The Ecological Footprint of Neural Machine Translation Systems

Dimitar Sherionov, Eva Vanmassenhove

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, nVidia GeForce GTX 1080 Ti, Package, Tesla P100

February 13, 2022 by hgpu

FC_ACCEL: Enabling Efficient, Low-Latency and Flexible Inference in DNN Fully Connected Layers, using Optimized Checkerboard Block matrix decomposition, fast scheduling, and a resource efficient 1D PE array with a custom HBM2 memory subsystem

Nick Iliev, Amit R Trivedi

View

Download (PDF)

Tags: CNN, Computer science, Deep learning, FPGA, Matrix decomposition, Neural networks, nVidia, nVidia Jetson AGX Xavier, Performance

February 13, 2022 by hgpu

Performance prediction of deep learning applications training in GPU as a service systems

Marco Lattuada, Eugenio Gianniti, Danilo Ardagna, Li Zhang

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 1080 Ti, Performance, Tesla K80, Tesla M60

January 30, 2022 by hgpu

Building a Performance Model for Deep Learning Recommendation Model Training on GPUs

Zhongyi Lin, Louis Feng, Ehsan K. Ardestani, Jaewon Lee, John Lundell, Changkyu Kim, Arun Kejariwal, John D. Owens

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce GTX Titan XP, Package, Performance, Tesla P100, Tesla V100

January 23, 2022 by hgpu

high performance computing on graphics processing units: hgpu.org

Deep Learning Models on CPUs: A Methodology for Efficient Training

CoDL: Efficient CPU-GPU Co-execution for Deep Learning Inference on Mobile Devices

Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml

GPUNet: Searching the Deployable Convolution Neural Networks for GPUs

One-shot tuner for deep learning compilers

Enabling On-Device Smartphone GPU based Training: Lessons Learned

A Comprehensive Benchmark of Deep Learning Libraries on Mobile Devices

The Ecological Footprint of Neural Machine Translation Systems

FC_ACCEL: Enabling Efficient, Low-Latency and Flexible Inference in DNN Fully Connected Layers, using Optimized Checkerboard Block matrix decomposition, fast scheduling, and a resource efficient 1D PE array with a custom HBM2 memory subsystem

Performance prediction of deep learning applications training in GPU as a service systems

Building a Performance Model for Deep Learning Recommendation Model Training on GPUs

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)