high performance computing on graphics processing units: hgpu.org

hgpu.org » MPI

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Re'em Harel, Matan Rusanovsky, Ron Wagner, Harel Levin, Gal Oren

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Fortran, HPC, MPI, Package, Performance

September 11, 2022 by hgpu

The OpenMP Cluster Programming Model

Hervé Yviquel, Marcio Pereira, Emílio Francesquini, Guilherme Valarini, Gustavo Leite, Pedro Rosso, Rodrigo Ceccato, Carla Cusihualpa, Vitoria Dias, Sandro Rigo, Alan Sousa, Guido Araujo

View

Download (PDF)

Source codes

Tags: Computer science, MPI, OpenMP, Package

July 17, 2022 by hgpu

MapReduce for Counting Word Frequencies with MPI and GPUs

Nithin Kavi

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Julia, MapReduce, MPI, NLP, nVidia, Optimization, Package, Tesla V100

June 19, 2022 by hgpu

CuPBoP: CUDA for Parallelized and Broad-range Processors

Ruobing Han, Jun Chen, Bhanu Garg, Jeffrey Young, Jaewoong Sim, Hyesoon Kim

View

Download (PDF)

Tags: Benchmarking, Compilers, Computer science, CUDA, Heterogeneous systems, HIP, MPI, nVidia, nVidia GeForce GTX 1660 Ti, OpenMP

June 19, 2022 by hgpu

Portable, Scalable Approaches for Improving Asynchronous Many-Task Runtime Node Use

John Keith Holmen

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, MPI, nVidia, nVidia GeForce GTX Titan X, performance portability, Task scheduling

June 5, 2022 by hgpu

The Celerity High-level API: C++20 for Accelerator Clusters

Peter Thoman, Florian Tischler, Philip Salzmann, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Data parallelism, MPI, nVidia, nVidia GeForce RTX 2070, Package, Programming techniques, SYCL

May 1, 2022 by hgpu

Machine Learning for CUDA+MPI Design Rules

Carl Pearson, Aurya Javeed, Karen Devine

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Monte Carlo simulation, MPI, nVidia, nVidia A100

March 20, 2022 by hgpu

HipBone: A performance-portable GPU-accelerated C++ version of the NekBone benchmark

Noel Chalmers, Abhishek Mishra, Damon McDougall, Tim Warburton

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Benchmarking, Computer science, CUDA, HIP, HPC, MPI, nVidia, Package, Performance, Tesla V100

March 11, 2022 by hgpu

Integrating SkePU’s algorithmic skeletons with GPI on a cluster

Joel Almqvist

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, HPC, MPI, nVidia, OpenCL, OpenMP, Thesis

March 6, 2022 by hgpu

Performance Evaluation of Python ParallelProgramming Models: Charm4Py and mpi4py

Zane Fink, Simeng Liu, Jaemin Choi, Matthias Diener, Laxmikant V. Kale

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Distributed computing, HPC, Machine learning, MPI, nVidia, Package, Performance, Python, Tesla V100

November 14, 2021 by hgpu

Monitoring Collective Communication Among GPUs

Muhammet Abdullah Soyturk, Palwisha Akhtar, Erhan Tezcan, Didem Unat

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, MPI, nVidia, Package, Performance, Tesla V100

October 24, 2021 by hgpu

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

Nawras Alnaasan, Arpan Jain, Aamir Shafi, Hari Subramoni, Dhabaleswar K Panda

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, HPC, Machine learning, MPI, nVidia, Python, Tesla V100

October 24, 2021 by hgpu

HipKittens: Fast and Furious AMD Kernels

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

LC Framework

Characterizing the Performance of Parallel Data-Compression Algorithms across Compilers and GPUs

pplx-garden: Perplexity open source garden for inference technology

RDMA Point-to-Point Communication for LLM Systems

OpScanner

A Study of Floating-Point Precision Tuning in Deep Learning Operators Implementations

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

Scalable GPU-Based Integrity Verification for Large Machine Learning Models

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

Enhancing Transformer Performance and Portability through Auto-tuning Frameworks

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

The OpenMP Cluster Programming Model

MapReduce for Counting Word Frequencies with MPI and GPUs

CuPBoP: CUDA for Parallelized and Broad-range Processors

Portable, Scalable Approaches for Improving Asynchronous Many-Task Runtime Node Use

The Celerity High-level API: C++20 for Accelerator Clusters

Machine Learning for CUDA+MPI Design Rules

HipBone: A performance-portable GPU-accelerated C++ version of the NekBone benchmark

Integrating SkePU’s algorithmic skeletons with GPI on a cluster

Performance Evaluation of Python ParallelProgramming Models: Charm4Py and mpi4py

Monitoring Collective Communication Among GPUs

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

Recent source codes

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

mt4g: Memory Topology 4 GPUs

Falcon: GPU-Based Floating-point Adaptive Lossless Compression

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

LC Framework

pplx-garden: Perplexity open source garden for inference technology

OpScanner

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

Most viewed papers (last 30 days)