high performance computing on graphics processing units: hgpu.org

Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, Jing Dong, Brandon Amos, Mustafa Mukadam

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Nonlinear optimization, nVidia, Package, Tesla V100

July 24, 2022 by hgpu

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Philip Jon Børgesen

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Performance, Thesis

July 17, 2022 by hgpu

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

GGArray: A Dynamically Growable GPU Array

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Fully Concurrent GPU Data Structures

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Optimization of GPU workloads using natural language processing based on deep learning techniques

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

COX: Exposing CUDA Warp-Level Functions to CPUs

Design and Implementation of ShenWei Universal C/C++

Demystifying Dependency Bugs in Deep Learning Stack

Theseus: A Library for Differentiable Nonlinear Optimization

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Recent source codes

OpScanner

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

INT v.s. FP: A framework to compare low-bit integer and float-point formats

AutoDock-GPU: AutoDock for GPUs and other accelerators

NCCLX: collective communication framework

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Most viewed papers (last 30 days)