high performance computing on graphics processing units: hgpu.org

hgpu.org » GPU cluster

Balancing Tracking Granularity and Parallelism in Many-Task Systems: The Horizons Approach

Peter Thoman, Philip Salzmann

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, GPU cluster, HPC, nVidia, nVidia V100, Package, SYCL

April 14, 2024 by hgpu

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Shiwei Zhang, Lansong Diao, Chuan Wu, Zongyan Cao, Siyu Wang, Wei Lin

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia A100, nVidia P100, nVidia V100, Package, PyTorch

January 14, 2024 by hgpu

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

Jiajun Huang, Sheng Di, Xiaodong Yu, Yujia Zhai, Jinyang Liu, Yafan Huang, Ken Raffenetti, Hui Zhou, Kai Zhao, Zizhong Chen, Franck Cappello, Yanfei Guo, Rajeev Thakur

View

Download (PDF)

Tags: Compression, Computer science, GPU cluster, MPI, nVidia, nVidia A100

August 13, 2023 by hgpu

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Kaijie Fan, Marco D'Antonio, Lorenzo Carpentieri, Biagio Cosenza, Federico Ficarelli, Daniele Cesarini

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, Energy-efficient computing, GPU cluster, Heterogeneous systems, Machine learning, nVidia, nVidia V100, SYCL

August 13, 2023 by hgpu

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Xinchi Han, Weihao Jiang, Peirui Cao, Qinwei Yang, Yunzhuo Liu, Shuyao Qi, Shengkai Lin, Shizhen Zhao

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Machine learning, Neural networks, nVidia, nVidia V100, Package

August 13, 2023 by hgpu

Communication-minimizing Asynchronous Tensor Parallelism

Siddharth Singh, Zack Sating, Abhinav Bhatele

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Neural networks, nVidia, nVidia A100

May 28, 2023 by hgpu

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Philip Salzmann, Fabian Knorr, Peter Thoman, Philipp Gschwandtner, Biagio Cosenza, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, GPU cluster, MPI, nVidia, nVidia V100, Package, SYCL

May 21, 2023 by hgpu

Energy-Efficient GPU Clusters Scheduling for Deep Learning

Diandian Gu, Xintong Xie, Gang Huang, Xin Jin, Xuanzhe Liu

View

Download (PDF)

Tags: Computer science, Deep learning, Energy-efficient computing, GPU cluster, Neural networks, nVidia, Tesla V100

April 16, 2023 by hgpu

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

Menglu Yu, Bo Ji, Hridesh Rajan, Jia Liu

View

Download (PDF)

Tags: Computer science, Deep learning, GPU cluster, Task scheduling

July 24, 2022 by hgpu

The Application of AI Technology in GPU Scheduling Algorithm Optimization

Zhancai Yan, Yaqiu Liu, Hongrun Shao

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, GPU cluster, nVidia, Task scheduling

May 22, 2022 by hgpu

General purpose lattice QCD code set Bridge++ 2.0 for high performance computing

Yutaro Akahoshi, Sinya Aoki, Tatsumi Aoyama, Issaku Kanamori, Kazuyuki Kanaya, Hideo Matsufuru, Yusuke Namekawa, Hidekatsu Nemura, Yusuke Taniguchi

View

Download (PDF)

Source codes

Tags: GPU cluster, HEP, High Energy Physics - Lattice, Numerical simulation, nVidia, OpenACC, Package, Physics, QCD, Tesla V100

November 14, 2021 by hgpu

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Jan Solanti, Michal Babej, Julius Ikkala, Vinod Kumar Malamal Vadakital, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce GTX 1060, nVidia GeForce GTX 2080 Ti, OpenCL, Package, Rendering, Tesla P100, Tesla V100

August 8, 2021 by hgpu

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

high performance computing on graphics processing units: hgpu.org

Balancing Tracking Granularity and Parallelism in Many-Task Systems: The Horizons Approach

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Communication-minimizing Asynchronous Tensor Parallelism

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Energy-Efficient GPU Clusters Scheduling for Deep Learning

On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

The Application of AI Technology in GPU Scheduling Algorithm Optimization

General purpose lattice QCD code set Bridge++ 2.0 for high performance computing

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Recent source codes

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

GPU plugin for PySCF

QArray

Celerity: High-level C++ for Accelerator Clusters

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

OpenMC Monte Carlo Code

Polygeist: C/C++ frontend for MLIR

Parallel Gaussian process with kernel approximation in CUDA

Most viewed papers (last 30 days)