high performance computing on graphics processing units: hgpu.org

hgpu.org » GPU cluster

The Application of AI Technology in GPU Scheduling Algorithm Optimization

Zhancai Yan, Yaqiu Liu, Hongrun Shao

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, GPU cluster, nVidia, Task scheduling

May 22, 2022 by hgpu

General purpose lattice QCD code set Bridge++ 2.0 for high performance computing

Yutaro Akahoshi, Sinya Aoki, Tatsumi Aoyama, Issaku Kanamori, Kazuyuki Kanaya, Hideo Matsufuru, Yusuke Namekawa, Hidekatsu Nemura, Yusuke Taniguchi

View

Download (PDF)

Source codes

Tags: GPU cluster, HEP, High Energy Physics - Lattice, Numerical simulation, nVidia, OpenACC, Package, Physics, QCD, Tesla V100

November 14, 2021 by hgpu

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Jan Solanti, Michal Babej, Julius Ikkala, Vinod Kumar Malamal Vadakital, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Heterogeneous systems, Matrix multiplication, nVidia, nVidia GeForce GTX 1060, nVidia GeForce GTX 2080 Ti, OpenCL, Package, Rendering, Tesla P100, Tesla V100

August 8, 2021 by hgpu

Efficient Large-Scale Language Model Training on GPU Clusters

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, NLP, nVidia, nVidia DGX-A100, Package

April 18, 2021 by hgpu

Python Workflows on HPC Systems

Dominik Strassel, Philipp Reusch, Janis Keuper

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, HPC, Machine learning, nVidia, PC cluster, Python

December 6, 2020 by hgpu

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

Jianqi Lai, Hang Yu, Zhengyu Tian, Hua Li

View

Download (PDF)

Tags: cfd, CUDA, Fluid dynamics, GPU cluster, HPC, MPI, nVidia, nVidia GeForce GTX 1070, OpenMP, Tesla V100

September 27, 2020 by hgpu

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, Amar Phanishayee, Matei Zaharia

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, FPGA, GPU cluster, Heterogeneous systems, nVidia, Optimization, Task scheduling, Tesla K80, Tesla P100, Tesla V100

August 30, 2020 by hgpu

Ignite-GPU: a GPU-enabled in-memory computing architecture on clusters

Amir Hossein Sojoodi, Majid Salimi Beni, Farshad Khunjush

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, GPU cluster, nVidia, nVidia GeForce GTX 680, Package

August 9, 2020 by hgpu

OpenSBLI: Automated code-generation for heterogeneous computing architectures applied to compressible fluid dynamics on structured grids

David J. Lusher, Satya P. Jammy, Neil D. Sandham

View

Download (PDF)

Source codes

Tags: cfd, Code generation, CUDA, Fluid dynamics, GPU cluster, Heterogeneous systems, Numerical simulation, nVidia, OpenCL, OpenMP, OpenMPI, Package, Python, Tesla P100

August 2, 2020 by hgpu

HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism

Jay H. Park, Gyeongchan Yun, Chang M. Yi, Nguyen T. Nguyen, Seungmin Lee, Jaesik Choi, Sam H. Noh, Young-ri Choi

View

Download (PDF)

Tags: Computer science, CUDA, Data parallelism, Deep learning, GPU cluster, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX Titan V, nVidia GeForce RTX 2060, nVidia Quadro P 4000, nVidia Titan RTX

May 31, 2020 by hgpu

Literature Review and Implementation Overview: High Performance Computing with Graphics Processing Units for Classroom and Research Use

Nathan George

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Education, GPU cluster, HPC, nVidia, nVidia GeForce GTX 1080 Ti, nVidia Quadro RTX 5000, Overview

May 24, 2020 by hgpu

Characterizing Deep Learning Training Workloads on Alibaba-PAI

Mengdi Wang, Chen Meng, Guoping Long, Chuan Wu, Jun Yang, Wei Lin, Yangqing Jia

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Computer vision, Deep learning, GPU cluster, nVidia, Tesla V100

October 20, 2019 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

The Application of AI Technology in GPU Scheduling Algorithm Optimization

General purpose lattice QCD code set Bridge++ 2.0 for high performance computing

PoCL-R: A Scalable Low Latency Distributed OpenCL Runtime

Efficient Large-Scale Language Model Training on GPU Clusters

Python Workflows on HPC Systems

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Ignite-GPU: a GPU-enabled in-memory computing architecture on clusters

OpenSBLI: Automated code-generation for heterogeneous computing architectures applied to compressible fluid dynamics on structured grids

HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism

Literature Review and Implementation Overview: High Performance Computing with Graphics Processing Units for Classroom and Research Use

Characterizing Deep Learning Training Workloads on Alibaba-PAI

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)