high performance computing on graphics processing units: hgpu.org

Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, Jing Dong, Brandon Amos, Mustafa Mukadam

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Nonlinear optimization, nVidia, Package, Tesla V100

July 24, 2022 by hgpu

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

Menglu Yu, Bo Ji, Hridesh Rajan, Jia Liu

View

Download (PDF)

Tags: Computer science, Deep learning, GPU cluster, Task scheduling

July 24, 2022 by hgpu

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

Jordan Langham-Lopez, Sebastian M. Schmon, Patrick Cannon

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce GTX 1650, Performance

July 17, 2022 by hgpu

Design and Implementation of CNN-FPGA accelerator based on Open Computing Language

Praveena Bai Desavathu, A Ravi Raja, Er. Sipra Patra, Rabinarayan Satpathy, S. John Pimo, Sankararao Majji

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, Deep learning, FPGA, Neural networks, OpenCL, Package

July 10, 2022 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Long Code for Code Search

BenchPress: A Deep Active Benchmark Generator

Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Optimization of GPU workloads using natural language processing based on deep learning techniques

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

Deep Learning Approaches to Source Code Analysis for Optimization of Heterogeneous Systems: Recent Results, Challenges and Opportunities

Demystifying Dependency Bugs in Deep Learning Stack

Theseus: A Library for Differentiable Nonlinear Optimization

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

Design and Implementation of CNN-FPGA accelerator based on Open Computing Language

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)