high performance computing on graphics processing units: hgpu.org

hgpu.org » Distributed computing

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

Jan Solanti, Michal Babej, Julius Ikkala, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, Distributed computing, Fluid dynamics, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A6000, OpenCL, Package, Rendering

September 6, 2023 by hgpu

A High-Performance Computing Cluster for Distributed Deep Learning: A Practical Case of Weed Classification Using Convolutional Neural Network Models

Manuel López-Martínez, Germán Díaz-Flórez, Santiago Villagrana-Barraza, Luis O. Solís-Sánchez, Héctor A. Guerrero-Osuna, Genaro M. Soto-Zarazúa, Carlos A. Olvera-Olvera

View

Download (PDF)

Tags: CUDA, Deep learning, Distributed computing, HPC, Image processing, Neural networks, nVidia, nVidia GeForce GTX 1050 Ti

June 4, 2023 by hgpu

ARK: GPU-driven Code Execution for Distributed Deep Learning

Changho Hwang, KyoungSoo Park, Ran Shu, Xinyuan Qu, Peng Cheng, Yongqiang Xiong

View

Download (PDF)

Tags: Computer science, Deep learning, Distributed computing, nVidia, nVidia V100

March 12, 2023 by hgpu

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Jinfan Chen, Shigang Li, Ran Gun, Jinhui Yuan, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia A100, Package, Tesla P100

January 22, 2023 by hgpu

Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

Nina Herrmann, Herbert Kuchen

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Heterogeneous systems, nVidia, nVidia GeForce GTX 750 Ti, nVidia GeFroce RTX 2080 Ti, nVidia Quadro K620

January 15, 2023 by hgpu

Kernel-as-a-Service: A Serverless Interface to GPUs

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, Joseph Gonzalez

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, nVidia, Package, Tesla V100

December 25, 2022 by hgpu

Integrating SkePU’s algorithmic skeletons with GPI on a cluster

Joel Almqvist

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, HPC, MPI, nVidia, OpenCL, OpenMP, Thesis

March 6, 2022 by hgpu

Lightning: Scaling the GPU Programming Model Beyond a Single GPU

Stijn Heldens, Pieter Hijma, Ben van Werkhoven, Jason Maassen, Rob V. van Nieuwpoort

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Distributed computing, nVidia, OpenCL, Package, Performance, Tesla P100

February 20, 2022 by hgpu

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments

Ji Liu, Zhihua Wu, Dianhai Yu, Yanjun Ma, Danlei Feng, Minxu Zhang, Xinxuan Wu, Xuefeng Yao, Dejing Dou

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Distributed computing, Heterogeneous systems, Neural networks, nVidia, Package, Tesla V100

November 28, 2021 by hgpu

Performance Evaluation of Python ParallelProgramming Models: Charm4Py and mpi4py

Zane Fink, Simeng Liu, Jaemin Choi, Matthias Diener, Laxmikant V. Kale

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Distributed computing, HPC, Machine learning, MPI, nVidia, Package, Performance, Python, Tesla V100

November 14, 2021 by hgpu

GPU-aware Communication with UCX in Parallel Programming Models: Charm++, MPI, and Python

Jaemin Choi, Zane Fink, Sam White, Nitin Bhat, David F. Richards, Laxmikant V. Kale

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Distributed computing, MPI, nVidia, Package, Python, Tesla V100

February 28, 2021 by hgpu

Efficient MPI-based Communication for GPU-Accelerated Dask Applications

Aamir Shafi, Jahanzeb Maqbool Hashmi, Hari Subramoni, Dhabaleswar K. (DK) Panda

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, Package, Performance, Python, Tesla V100

January 31, 2021 by hgpu

Beehive SPIR-V Toolkit

Beehive SPIR-V Toolkit: A Composable and Functional API for Runtime SPIR-V Code Generation

CATO: automatic source transformation to apply HPC frameworks with minimal user interaction

Compiler-assisted distribution of OpenMP code for improved scalability

ADIOS2.jl: a Julia interface to ADIOS2

Julia as a unifying end-to-end workflow language on the Frontier exascale system

Code generated HPC Kernels Using Llama-2-70b

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

pocl - Portable Computing Language

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

* * *

high performance computing on graphics processing units: hgpu.org

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

A High-Performance Computing Cluster for Distributed Deep Learning: A Practical Case of Weed Classification Using Convolutional Neural Network Models

ARK: GPU-driven Code Execution for Distributed Deep Learning

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

Integrating SkePU’s algorithmic skeletons with GPI on a cluster

Lightning: Scaling the GPU Programming Model Beyond a Single GPU

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments

Performance Evaluation of Python ParallelProgramming Models: Charm4Py and mpi4py

GPU-aware Communication with UCX in Parallel Programming Models: Charm++, MPI, and Python

Efficient MPI-based Communication for GPU-Accelerated Dask Applications

Recent source codes

Beehive SPIR-V Toolkit

CATO: automatic source transformation to apply HPC frameworks with minimal user interaction

ADIOS2.jl: a Julia interface to ADIOS2

Code generated HPC Kernels Using Llama-2-70b

Scope is all you need: Transforming LLMs for HPC Code

pocl - Portable Computing Language

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

openCLDispatcher

CEED Benchmarks

Sieve: Stratified GPU-Compute Workload Sampling

Most viewed papers (last 30 days)