high performance computing on graphics processing units: hgpu.org

Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, Jing Dong, Brandon Amos, Mustafa Mukadam

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Nonlinear optimization, nVidia, Package, Tesla V100

July 24, 2022 by hgpu

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Philip Jon Børgesen

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Performance, Thesis

July 17, 2022 by hgpu

Just-in-Time Compilation and Link-Time Optimization for OpenMP Target Offloading

Shilei Tian, Joseph Huber, Barbara Chapman, Johannes Doerfert

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, OpenMP

July 17, 2022 by hgpu

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

Jordan Langham-Lopez, Sebastian M. Schmon, Patrick Cannon

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce GTX 1650, Performance

July 17, 2022 by hgpu

High-Performance GPU-to-CPU Transpilation and Optimization via High-Level Parallel Constructs

William S. Moses, Ivan R. Ivanov, Jens Domke, Toshio Endo, Johannes Doerfert, Oleksandr Zinenko

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce RTX 2080 Ti, Package, performance portability, Programming Languages

July 10, 2022 by hgpu

Evaluation of Intel’s DPC++ Compatibility Tool in heterogeneous computing

Germán Castaño, Youssef Faqir-Rhazoui, Carlos García, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, nVidia, Package, Performance, SYCL

July 3, 2022 by hgpu

CuPBoP-AMD: Extending CUDA to AMD Platforms

CuPBoP: Making CUDA a Portable Language

Adopter: Automated Deep Learning Optimization via DSL-based Source Code Transformation

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

ROCm's implementation of Gromacs

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

Experiences with implementing Kokkos’ SYCL backend

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

SimSYCL: A SYCL Implementation Targeting Development, Debugging, Simulation and Conformance

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

94% on CIFAR-10 in 3.29 Seconds on a Single GPU

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Optimization of GPU workloads using natural language processing based on deep learning techniques

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

COX: Exposing CUDA Warp-Level Functions to CPUs

Design and Implementation of ShenWei Universal C/C++

Demystifying Dependency Bugs in Deep Learning Stack

Theseus: A Library for Differentiable Nonlinear Optimization

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Just-in-Time Compilation and Link-Time Optimization for OpenMP Target Offloading

High Performance Simulation for Scalable Multi-Agent Reinforcement Learning

High-Performance GPU-to-CPU Transpilation and Optimization via High-Level Parallel Constructs

Evaluation of Intel’s DPC++ Compatibility Tool in heterogeneous computing

Recent source codes

CuPBoP-AMD: Extending CUDA to AMD Platforms

Adopter: Automated Deep Learning Optimization via DSL-based Source Code Transformation

ROCm's implementation of Gromacs

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

GPU plugin for PySCF

QArray

Celerity: High-level C++ for Accelerator Clusters

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

Most viewed papers (last 30 days)