high performance computing on graphics processing units: hgpu.org

hgpu.org » CUDA

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Jinfan Chen, Shigang Li, Ran Gun, Jinhui Yuan, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia A100, Package, Tesla P100

January 22, 2023 by hgpu

PySAGES: flexible, advanced sampling methods accelerated with GPUs

Pablo F. Zubieta Rico, Ludwig Schneider, Gustavo Perez-Lemus, Riccardo Alessandri, Siva Dasetty, Cintia A. Menéndez, Yiheng Wu, Yezhi Jin, Trung Nguyen, John Parker, Andrew L. Ferguson, Juan J. de Pablo

View

Download (PDF)

Source codes

Tags: Biology, Chemistry, Computational Physics, CUDA, Molecular dynamics, nVidia, Package, Physics, Python, Tesla V100

January 22, 2023 by hgpu

A Programming Model for GPU Load Balancing

Muhammad Osama, Serban D. Porumbescu, John D. Owens

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, load balancing, nVidia, Package, Tesla V100

January 15, 2023 by hgpu

Improving the scalability of modern applications by parallel multi-core and many-core programming

Alessandro Borione

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Graph theory, nVidia, nVidia GeForce RTX 3070, OpenCL, Thesis

January 15, 2023 by hgpu

Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

Nina Herrmann, Herbert Kuchen

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Heterogeneous systems, nVidia, nVidia GeForce GTX 750 Ti, nVidia GeFroce RTX 2080 Ti, nVidia Quadro K620

January 15, 2023 by hgpu

Arax: a runtime framework for decoupling applications from heterogeneous accelerators

Manos Pavlidakis, Stelios Mavridis, Antony Chazapis, Giorgos Vasiliadis, Angelos Bilas

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce RTX 2080, OpenCL, Package

January 8, 2023 by hgpu

Extending MAGMA Portability with OneAPI

Anna Fortenberry, Stanimire Tomov

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce RTX 3060, oneAPI, Package, performance portability

December 25, 2022 by hgpu

GPU Load Balancing

Muhammad Osama

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, load balancing, Matrix multiplication, nVidia, nVidia A100, Package, Sparse, Thesis

December 25, 2022 by hgpu

Kernel-as-a-Service: A Serverless Interface to GPUs

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, Joseph Gonzalez

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, nVidia, Package, Tesla V100

December 25, 2022 by hgpu

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

August Ernstsson, Dalvan Griebler, Christoph Kessler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL, OpenMP, Package, performance portability, Tesla K20

December 11, 2022 by hgpu

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

Mariko Tatsumi, Silviu-Ioan Filip, Caroline White, Olivier Sentieys, Guy Lemieux

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, FPGA, nVidia, Precision

December 11, 2022 by hgpu

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, HPC, nVidia, PyTorch, Tesla V100

December 11, 2022 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

No More Shading Languages: Compiling C++ to Vulkan Shaders

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

Engineering Supercomputing Platforms for Biomolecular Applications

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

chemtrain-deploy: A parallel and scalable framework for machine learning potentials in million-atom MD simulations

microSYCL: SYCL micro-benchmarks repository

Exploring SYCL as a Portability Layer for High-Performance Computing on CPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

PySAGES: flexible, advanced sampling methods accelerated with GPUs

A Programming Model for GPU Load Balancing

Improving the scalability of modern applications by parallel multi-core and many-core programming

Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

Arax: a runtime framework for decoupling applications from heterogeneous accelerators

Extending MAGMA Portability with OneAPI

GPU Load Balancing

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Recent source codes

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

exa-AMD: Exascale Accelerated Materials Discovery

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

microSYCL: SYCL micro-benchmarks repository

Most viewed papers (last 30 days)