high performance computing on graphics processing units: hgpu.org

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

A Hybrid Parallelization Approach for Distributed and Scalable Deep Learning

Samson B. Akintoye, Liangxiu Han, Xin Zhang, Haoming Chen, Daoqiang Zhang

View

Download (PDF)

Tags: Computer science, CUDA, Data parallelism, Deep learning, Neural networks, nVidia, Tesla V100

April 18, 2021 by hgpu

Multiple-Tasks on Multiple-Devices (MTMD): Exploiting Concurrency in Heterogeneous Managed Runtimes

Michail Papadimitriou, Eleni Markou, Juan Fumero, Athanasios Stratikopoulos, Florin Blanaru, Christos Kotselidis

View

Download (PDF)

Tags: Computer science, Heterogeneous systems, Java, Machine learning, nVidia, nVidia GeForce GTX 1650, OpenCL

April 11, 2021 by hgpu

Performance Monitoring of Multi-FPGA Systems

Arzhang Rafii

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, Package, Performance, Thesis

April 11, 2021 by hgpu

Efficient Video Compression via Content-Adaptive Super-Resolution

Mehrdad Khani, Vibhaalakshmi Sivaraman, Mohammad Alizadeh

View

Download (PDF)

Source codes

Tags: Compression, Computer science, Deep learning, Neural networks, nVidia, Package, Tesla V100

April 11, 2021 by hgpu

An Investigation of Atomic Synchronization for Sort-Based Group-By Aggregation on GPUs

Bala Gurumurthy, David Broneske, Martin Schaler, Thilo Pionteck, Gunter Saake

View

Download (PDF)

Tags: Computer science, Databases, Hashing, Heterogeneous systems, nVidia, nVidia GeForce GTX 1050 Ti, nVidia GeForce RTX 2080 Ti, OpenCL, Sorting

April 5, 2021 by hgpu

CuPBoP-AMD: Extending CUDA to AMD Platforms

CuPBoP: Making CUDA a Portable Language

Adopter: Automated Deep Learning Optimization via DSL-based Source Code Transformation

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

ROCm's implementation of Gromacs

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

Experiences with implementing Kokkos’ SYCL backend

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

SimSYCL: A SYCL Implementation Targeting Development, Debugging, Simulation and Conformance

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

94% on CIFAR-10 in 3.29 Seconds on a Single GPU

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Deep Graph Learning for Program Analysis and System Optimization

Ripple: Simplified Large-Scale Computation on Heterogeneous Architectures with Polymorphic Data Layout

CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU

Performance Analysis and Optimization Opportunities for NVIDIA Automotive GPUs

SLATE port to AMD and Intel platforms

FANS: FPGA-Accelerated Near-Storage Sorting

Efficient Large-Scale Language Model Training on GPU Clusters

A Hybrid Parallelization Approach for Distributed and Scalable Deep Learning

Multiple-Tasks on Multiple-Devices (MTMD): Exploiting Concurrency in Heterogeneous Managed Runtimes

Performance Monitoring of Multi-FPGA Systems

Efficient Video Compression via Content-Adaptive Super-Resolution

An Investigation of Atomic Synchronization for Sort-Based Group-By Aggregation on GPUs

Recent source codes

CuPBoP-AMD: Extending CUDA to AMD Platforms

Adopter: Automated Deep Learning Optimization via DSL-based Source Code Transformation

ROCm's implementation of Gromacs

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

GPU plugin for PySCF

QArray

Celerity: High-level C++ for Accelerator Clusters

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

Most viewed papers (last 30 days)