high performance computing on graphics processing units: hgpu.org

Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Meghan Cowan, Haichen Shen, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, FPGA, Machine learning, nVidia, nVidia GeForce GTX Titan X, Optimization, Package, performance portability

October 13, 2018 by hgpu

Sparse Winograd Convolutional neural networks on small-scale systolic arrays

Feng Shi, Haochen Li, Yuhe Gao, Benjamin Kuschner, Song-Chun Zhu

View

Download (PDF)

Tags: Analytical model, Computer science, Deep learning, FPGA, Neural networks

October 13, 2018 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Modeling Deep Learning Accelerator Enabled GPUs

FusionStitching: Deep Fusion and Code Generation for Tensorflow Computations on GPUs

The AlexNet Moment for Homomorphic Encryption: HCNN, the First Homomorphic CNN on Encrypted Data with GPUs

Workload-aware Automatic Parallelization for Multi-GPU DNN Training

Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation

A Comparative Measurement Study of Deep Learning as a Service Framework

The Ocean Tensor Package

Towards Efficient Large-Scale Graph Neural Network Computing

A Survey of FPGA-based Accelerators for Convolutional Neural Networks

AI Benchmark: Running Deep Neural Networks on Android Smartphones

TVM: An Automated End-to-End Optimizing Compiler for Deep Learning

Sparse Winograd Convolutional neural networks on small-scale systolic arrays

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR