high performance computing on graphics processing units: hgpu.org

Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, Jing Dong, Brandon Amos, Mustafa Mukadam

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Nonlinear optimization, nVidia, Package, Tesla V100

July 24, 2022 by hgpu

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

Menglu Yu, Bo Ji, Hridesh Rajan, Jia Liu

View

Download (PDF)

Tags: Computer science, Deep learning, GPU cluster, Task scheduling

July 24, 2022 by hgpu

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

SW#SYCL

Analyzing the Performance Portability of SYCL across CPUs, GPUs, and Hybrid Systems with Protein Database Search

tdg-benchs: benchmarks used to test the performance of taskgraph

Leveraging the potential of task-based programming with OpenMP task graphs

LLOR: Automatic Repair of OpenMP Programs

LLOR: Automated Repair of OpenMP Programs

Solomon: Simple Off-LOading Macros Orchestrating multiple Notations

Unified schemes for directive-based GPU offloading

CLUEstering: a high-performance density-based clustering library for scientific computing

PyOMP: OpenMP for Python in Numba

PyOMP: Parallel programming for CPUs and GPUs with OpenMP and Python

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Optimization of GPU workloads using natural language processing based on deep learning techniques

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

Deep Learning Approaches to Source Code Analysis for Optimization of Heterogeneous Systems: Recent Results, Challenges and Opportunities

Real-Time High-Performance Computing for Embedded Control Systems

COX: Exposing CUDA Warp-Level Functions to CPUs

Design and Implementation of ShenWei Universal C/C++

Demystifying Dependency Bugs in Deep Learning Stack

CPU-GPU Layer-Switched Low Latency CNN Inference

FPGA Accelerators on Heterogeneous Systems: An Approach Using High Level Synthesis

Theseus: A Library for Differentiable Nonlinear Optimization

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

Recent source codes

Matrix multiplication using Tensor Cores in CUDA

CPP Joules: Energy Measurement tool for CPP/CUDA programs

HPC-Coder-v2