high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

GPU-aware Communication with UCX in Parallel Programming Models: Charm++, MPI, and Python

Jaemin Choi, Zane Fink, Sam White, Nitin Bhat, David F. Richards, Laxmikant V. Kale

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Distributed computing, MPI, nVidia, Package, Python, Tesla V100

February 28, 2021 by hgpu

Using hardware performance counters to speed up autotuning convergence on GPUs

Jiří Filipovič, Jana Hozzová, Amin Nezarat, Jaroslav Oľha, Filip Petrovič

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Computer science, CUDA, HPC, Machine learning, nVidia, nVidia GeForce GTX 1070, nVidia GeForce RTX 2080, OpenCL, Package, Performance, Vulkan

February 23, 2021 by hgpu

Optimal program variant generation for hybrid manycore systems

Cristian Urlea

View

Download (PDF)

Tags: Computer science, Design space exploration, FPGA, Heterogeneous systems, OpenCL, performance portability, Thesis

February 21, 2021 by hgpu

cuFINUFFT: a load-balanced GPU library for general-purpose nonuniform FFTs

Yu-hsuan Shih, Garrett Wright, Joakim Andén, Johannes Blaschke, Alex H. Barnett

View

Download (PDF)

Source codes

Tags: CUDA, FFT, Image reconstruction, Mathematical Software, Numerical Analysis, nVidia, Package, Signal processing, Tesla V100

February 21, 2021 by hgpu

Serverless Computing Strategies on Cloud Platforms

Diana María Naranjo Delgado

View

Download (PDF)

Tags: Cloud, Computer science, CUDA, Machine learning, nVidia, Tesla V100, Thesis, Virtualization

February 14, 2021 by hgpu

Optimization of Data Assignment for Parallel Processing in a Hybrid Heterogeneous Environment Using Integer Linear Programming

Tomasz Boiński, Paweł Czarnul

View

Download (PDF)

Tags: Computer science, Heterogeneous systems, Intel Xeon Phi, nVidia, nVidia GeForce GTX 560 Ti, OpenCL, Tesla K20

February 14, 2021 by hgpu

Searching CUDA code autotuning spaces with hardware performance counters: data from benchmarks running on various GPU architectures

Jiří Filipovič, Jana Hozzová, Amin Nezarat, Jaroslav Oľha, Filip Petrovič

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Benchmarking, Computer science, CUDA, nVidia, nVidia GeForce GTX 1070, nVidia GeForce GTX 680, nVidia GeForce GTX 750, nVidia GeForce RTX 2080, Package

February 14, 2021 by hgpu

Transparent FPGA Acceleration with TensorFlow

Simon Pfenning, Philipp Holzinger, Marc Reichenbach

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, FPGA, Hardware Architecture, HSA, OpenCL, Package, TensorFlow

February 14, 2021 by hgpu

Dependable Embedded Systems

Jörg Henkel, Nikil Dutt (Editors)

View

Download (PDF)

Tags: Book, Computer science, FPGA, OpenCL

February 7, 2021 by hgpu

Computational Performance Predictions for Deep Neural Network Training: A Runtime-Based Approach

Geoffrey X. Yu, Yubo Gao, Pavel Golikov, Gennady Pekhimenko

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce RTX 2070, Performance, Python, Tesla P100, Tesla V100

February 7, 2021 by hgpu

C-for-Metal: High Performance SIMD Programming on Intel GPUs

Guei-Yuan Lueh, Kaiyu Chen, Gang Chen, Joel Fuentes, Wei-Yu Chen, Fangwen Fu, Hong Jiang, Hongzheng Li, Daniel Rhee

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, OpenCL, Package, Programming Languages

January 31, 2021 by hgpu

Performance of CPU and GPU HPC Architectures for off-design aircraft simulation

Mike Turner, Jamil Appa, Neil Ashton

View

Download (PDF)

Tags: cfd, CUDA, Fluid dynamics, MPI, nVidia, OpenMP, SYCL, Tesla A100, Tesla T4, Tesla V100

January 31, 2021 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

GPU-aware Communication with UCX in Parallel Programming Models: Charm++, MPI, and Python

Using hardware performance counters to speed up autotuning convergence on GPUs

Optimal program variant generation for hybrid manycore systems

cuFINUFFT: a load-balanced GPU library for general-purpose nonuniform FFTs

Optimization of Data Assignment for Parallel Processing in a Hybrid Heterogeneous Environment Using Integer Linear Programming

Searching CUDA code autotuning spaces with hardware performance counters: data from benchmarks running on various GPU architectures

Transparent FPGA Acceleration with TensorFlow

Dependable Embedded Systems

Computational Performance Predictions for Deep Neural Network Training: A Runtime-Based Approach

C-for-Metal: High Performance SIMD Programming on Intel GPUs

Performance of CPU and GPU HPC Architectures for off-design aircraft simulation

Recent source codes

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Most viewed papers (last 30 days)