high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

René Caspart, Sebastian Ziegler, Arvid Weyrauch, Holger Obermaier, Simon Raffeiner, Leon Pascal Schuhmacher, Jan Scholtyssek, Darya Trofimova, Marco Nolden, Ines Reinartz, Fabian Isensee, Markus Götz, Charlotte Debus

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Package

December 11, 2022 by hgpu

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

Mariko Tatsumi, Silviu-Ioan Filip, Caroline White, Olivier Sentieys, Guy Lemieux

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, FPGA, nVidia, Precision

December 11, 2022 by hgpu

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, HPC, nVidia, PyTorch, Tesla V100

December 11, 2022 by hgpu

Towards energy efficiency and productivity for decision making in mobile robot navigation

Denisa-Andreea Constantinescu

View

Download (PDF)

Tags: Computer science, nVidia, nVidia Jetson AGX Xavier, nVidia Jetson Nano, nVidia Jetson TX1, nVidia Jetson TX2, OpenCL, Robotics, SYCL

December 11, 2022 by hgpu

Fast convolution kernels on pascal GPU with high memory efficiency

Qiong Chang, Masaki Onishi, Tsutomu Maruyama

View

Download (PDF)

Tags: CNN, Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1080 Ti, Performance

December 4, 2022 by hgpu

Three Contributions to the Theory and Practice of Optimizing Compilers

Linxiao Wang

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, LLVM, nVidia, nVidia GeForce GTX 1080 Ti, nVidia GeForce GTX 760 M, Package, Thesis

December 4, 2022 by hgpu

Efficient Incremental Text-to-Speech on GPUs

Muyang Du, Chuan Liu, Jiaxing Qi, Junjie Lai

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, nVidia, nVidia A10, Tesla V100

December 4, 2022 by hgpu

SkyFlow: Heterogeneous streaming for skyline computation using FlowGraph and SYCL

Jose Carlos Romero, Angeles Navarro, Andres Rodrıguez, Rafael Asenjo

View

Download (PDF)

Tags: Computer science, Heterogeneous systems, Intel, Intel UHD 630, OpenMP, SYCL

December 4, 2022 by hgpu

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

User-Driven Online Kernel Fusion for SYCL

Victor Perez, Lukas Sommer, Victor Lomüller, Kumudha Narasimhan, Mehdi Goli

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, OpenCL, Package, SYCL

November 27, 2022 by hgpu

A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

Basilis Mamalis, Marios Perlitis

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, OpenMP

November 27, 2022 by hgpu

SciAI4Industry – Solving PDEs for industry-scale problems with deep learning

Philipp A. Witte, Russell J. Hewett, Kumar Saurabh, AmirHossein Sojoodi, Ranveer Chandra

View

Download (PDF)

Tags: AI, Cloud, Computational Physics, Computer science, Deep learning, Differential equations, Neural networks, nVidia, nVidia A100, nVidia DGX-A100, Partial differential equations, PDEs

November 27, 2022 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Towards energy efficiency and productivity for decision making in mobile robot navigation

Fast convolution kernels on pascal GPU with high memory efficiency

Three Contributions to the Theory and Practice of Optimizing Compilers

Efficient Incremental Text-to-Speech on GPUs

SkyFlow: Heterogeneous streaming for skyline computation using FlowGraph and SYCL

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

User-Driven Online Kernel Fusion for SYCL

A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)