high performance computing on graphics processing units: hgpu.org

René Caspart, Sebastian Ziegler, Arvid Weyrauch, Holger Obermaier, Simon Raffeiner, Leon Pascal Schuhmacher, Jan Scholtyssek, Darya Trofimova, Marco Nolden, Ines Reinartz, Fabian Isensee, Markus Götz, Charlotte Debus

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Package

December 11, 2022 by hgpu

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

August Ernstsson, Dalvan Griebler, Christoph Kessler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL, OpenMP, Package, performance portability, Tesla K20

December 11, 2022 by hgpu

Three Contributions to the Theory and Practice of Optimizing Compilers

Linxiao Wang

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, LLVM, nVidia, nVidia GeForce GTX 1080 Ti, nVidia GeForce GTX 760 M, Package, Thesis

December 4, 2022 by hgpu

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

BaCO: A Fast and Portable Bayesian Compiler Optimization Framework

Arax: a runtime framework for decoupling applications from heterogeneous accelerators

Understanding the Impact of Input Entropy on FPU, CPU, and GPU Power

Extending MAGMA Portability with OneAPI

mu-grind: A Framework for Dynamically Instrumenting HLS-Generated RTL

GPU Load Balancing

Portable C++ Code that can Look and Feel Like Fortran Code with Yet Another Kernel Launcher (YAKL)

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

Three Contributions to the Theory and Practice of Optimizing Compilers

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)